# Patrick Toulme

> Software Engineer @ Meta - MTIA Compiler and Performance

Location: New York, New York, United States
Profile: https://flows.cv/patricktoulme

Latest blog post: https://open.substack.com/pub/patricktoulme/p/when-xla-isnt-enough-from-pallas?r=2efpoc&utm_medium=ios&shareImageVariant=overlay

Working on high performance deep learning at Meta MTIA Compiler and Performance Team. Working on high performance compilers for Meta custom silicon and the PyTorch FX Compiler.

Previously at AWS Neuron working on the XLA compiler and kernel development.

I contribute actively to open source - https://github.com/patrick-toulme

Interests: Large language models, XLA, MLIR, HLO, MHLO, LLVM, Pallas, Triton, machine learning compilers, Jax, PyTorch, distributed training, PJRT, machine learning scaling, high performance computing, machine learning accelerators, pretraining, fine tuning, reinforcement learning, large accelerator clusters (Slurm)

## Work Experience
### Software Engineer - MTIA Compiler and Performance Team @ Meta
Jan 2025 – Present | New York, New York, United States
Software Engineer on MTIA Compiler and Performance Team.
Working on PyTorch FX Compiler for MTIA Silicon.

### Machine Learning Engineer II    |   AWS Neuron - Annapurna Labs @ Amazon Web Services (AWS)
Jan 2024 – Jan 2025 | Cupertino, California, United States
Promoted to Machine Learning Engineer II
- Currently working on the XLA compiler for the Neuron backend
- Middle end compiler loop optimizations
- High performance kernels targeting Neuron hardware

### Machine Learning Engineer | AWS Neuron - Annapurna Labs @ Amazon Web Services (AWS)
Jan 2023 – Jan 2024 | Cupertino, California, United States
Machine Learning Engineer on AWS Neuron Training Team - Annapurna Laboratories 
- High performance deep learning on Trn1 and Inf2 instances
- OpenXLA compiler passes
- PJRT support for Neuron backend
- Training on multi thousand Neuron device clusters. 
- GSPMD with PyTorch/Jax for automatic parallelization of machine learning computations.
- Distributed training for Bedrock
- Pretraining and fine tuning multi hundred billion parameter large language models on Neuron cores
- Training using XLA and PyTorch and Jax

https://aws.amazon.com/machine-learning/neuron/

### Software Engineer | AWS Bedrock @ Amazon Web Services (AWS)
Jan 2022 – Jan 2023 | Arlington, Virginia, United States
Software Engineer on AWS Bedrock Training Team
- Pretraining and fine tuning large language models (Titan models)
- Distributed multi node training using Deepspeed and NeMo

https://aws.amazon.com/bedrock/

### Researcher @ UVA Engineering
Jan 2020 – Jan 2022 | Charlottesville, Virginia, United States
Researching with Dr. Panagiotis Apostolellis on the development of using chatbots for depression screening. Currently using Google DialogFlow, Kommunicate and Swift to develop Marcus: Depression Screening.

### Software Engineer | Institutional Trading @ Coinbase
Jan 2022 – Jan 2022 | San Francisco, California, United States
Software Engineer on the Institutional Trading team. Layoff due to economic conditions

### Software Engineer @ Living Popups, LLC
Jan 2019 – Jan 2020 | Beverly Hills, California, United States
Worked as a software engineer working under the Chief Technology Officer and Lead Developer. I worked on a variety of projects, such as Boxcar AR, Boxcar ES and Orkney Origins. I worked extensively on all three applications. I also added Firebase database systems to the applications and developed the in app purchase and billing system for the applications. I also managed the applications on the App Store and Google Play Store

### Software Engineer @ Nimbly
Jan 2019 – Jan 2019 | New York City Metropolitan Area
Served as lead software engineer in the development of a full 3D store front simulation built in Unity. I reported to the CEO, and I built the project in a crunch deadline of only 2.5 weeks from contract signing to delivery by Nimbly to the client.


## Education
### Master of Science - MS in Computer Science - Concentration Artificial Intelligence
Georgia Institute of Technology

### Bachelor's degree in Computer Science
University of Virginia

### High School Diploma
Thomas Jefferson High School for Science and Technology


## Contact & Social
- LinkedIn: https://linkedin.com/in/patrick-toulme-150b041a5

---
Source: https://flows.cv/patricktoulme
JSON Resume: https://flows.cv/patricktoulme/resume.json
Last updated: 2026-04-05