# Matthew Howard > Senior Software Engineer at Cohere Health Location: Brooklyn, New York, United States Profile: https://flows.cv/matthewhoward DevOps ## Work Experience ### Senior Software Engineer @ Cohere Health Jan 2026 – Present ### DevOps Engineer @ Cohere Health Jan 2022 – Present Senior DevOps Engineer on the AI Platform team, owning cloud infrastructure and platform foundations for production AI workloads Building and operating a LiteLLM-based AI Gateway to enable secure, scalable, and cost-aware access to LLMs Implementing model observability and evaluation pipelines with Arize to support reliable AI experimentation and production monitoring Developing shared AI tooling and infrastructure for machine learning, data science, and application teams Led DevOps practices across insurance web services, improving reliability and streamlining user pre-authorization workflows Orchestrated containerized Python and Java applications using Docker in AWS environments to enable scalable, repeatable deployments Deployed and operated the ELK stack on AWS EC2 using Terraform, with a focus on performance, security, and cost optimization Implemented AWS PrivateLink for Kibana watchers to enable secure self-service monitoring and improved operational autonomy Executed IAM audits and automated access management using Terraform, implementing granular AWS IAM roles and policies Designed and managed network infrastructure including VPCs, security groups, and security audits to improve security posture and scalability Built and maintained CI/CD pipelines using GitHub Actions to improve developer velocity and delivery consistency Drove infrastructure reviews and optimizations that reduced AWS costs by approximately $40k annually ### Software Engineer II @ Cohere Health Jan 2021 – Present ### Software Engineer @ Cohere Health Jan 2021 – Present ### Software Developer @ RT Specialty Jan 2018 – Jan 2019 | Buffalo, New York, United States Full-stack engineer, specializing in front-end, API, and database development for an insurance binding website. Implemented features for the purchasing of high yield insurance add-on products. ○ Modified website to include new entry form for end user using Symphony, XSLT, CSS, PHP, and Javascript. ○ Took data entered via Javascript and loaded into local Mongo. ○ Transformed and sent data to back end SQL database. ○ Auto filled PDFs with data entered on web site. ○ Sent request through API for specific insurance company to ensure proper coverage bound. ○ Added endpoint to API for incoming quote requests. Utilize Agile Scrum with two week sprints with approximately 13 other developers. Develop automated Selenium unit tests leveraging Python and MongoDB to adhere to our TDD process. Debug and develop software-as-a-service Java modules for insurance binding process. Debug and treat legacy website framework written in standalone PHP and JavaScript. Explore new ways to improve and automate the development / deployment cycle. ### Software Developer @ nVisium Jan 2016 – Jan 2016 | Brooklyn, NY Used Java to develop back end classroom learning application in cyber security. Processed 200+ tickets for bugs and additional functionality Deployed Security Onion and Snort IDS scanner where there was previously no IDS. Maintain and monitor critical applications by improving upon dashboard. Helped develop more e􀁾cient process for generating and treating bug tickets ### Intern @ New York City Metro Transit Authority Jan 2014 – Jan 2014 | New York, NY Processed bug tickets usually Javascript or Python related. Processed approximately 15 system administrator tickets per week additionally. Con􀂁gured and manage critical NOC monitoring servers in remote locations around the City of NewYork. ### Intern @ New York City Board of Education Jan 2013 – Jan 2013 | New York, NY • Deployed new widget written in PHP to NOC dashboard to help team members quickly asses network health • Automated process of video storage server maintenance using C++ ## Education ### Bachelor's Degree in Computer Science University at Buffalo ### University of Kent ## Contact & Social - LinkedIn: https://linkedin.com/in/matthew-howard-85885668 --- Source: https://flows.cv/matthewhoward JSON Resume: https://flows.cv/matthewhoward/resume.json Last updated: 2026-04-13