# Deep Dhillon

> Inference @ Modular | Ex-Google

Location: San Francisco Bay Area, United States
Profile: https://flows.cv/deepdhillon

I'm a Senior Software Engineer at Modular, working on Mammoth 🦣 — a heterogeneous, distributed inference system designed to serve large models efficiently at scale across any hardware.

I focus on building high-performance serving and inference infrastructure, tackling challenges like optimized routing, real-time scheduling, topology-aware placement, and large-scale model execution across diverse compute. This work sits at the core of enabling fast, flexible, and cost-efficient LLM deployment and serving.

Previously, I was at Google, where I worked on infrastructure for cloud databases. I've also held engineering roles at SeatGeek, Shopify, and LoyaltyOne while studying at the University of Waterloo.

I'm deeply interested in distributed systems, especially where they intersect with AI/ML. I enjoy solving performance-critical problems and building systems that operate at scale, reliably and efficiently.

📍 github.com/dhillondeep

## Work Experience
### Staff Software Engineer @ Modular
Jan 2026 – Present

### Senior Software Engineer @ Modular
Jan 2024 – Present
Serving, Pipelines, Inference

### Software Engineer @ Modular
Jan 2023 – Jan 2024
Infrastructure, Multi-cloud, Services

### Software Engineer @ Google
Jan 2022 – Jan 2023
Infrastructure, Databases

### Platform Engineer @ SeatGeek
Jan 2021 – Jan 2021
Infrastructure, Tooling

### Production Engineer @ Shopify
Jan 2021 – Jan 2021
Infrastructure, Tooling

### Project Lead @ UW Blueprint
Jan 2020 – Jan 2020

### Backend Developer @ Shopify
Jan 2020 – Jan 2020

### Technical Director @ Waterloop - Canada's Hyperloop Team
Jan 2018 – Jan 2019 | Waterloo, Ontario

### Software Lead @ Waterloop - Canada's Hyperloop Team
Jan 2017 – Jan 2017 | Waterloo, Ontario

### Software Developer - Air Miles Offers @ LoyaltyOne
Jan 2019 – Jan 2019 | Toronto, Ontario

### Software Developer - Air Miles Accounts @ LoyaltyOne
Jan 2018 – Jan 2018 | Toronto, Ontario

### Software Developer @ Agfa HealthCare
Jan 2017 – Jan 2017 | Waterloo, Ontario

### Summer Student @ Region of Peel
Jan 2015 – Jan 2015 | Brampton, ON


## Education
### Bachelor of Mathematics in Mathematical Studies
University of Waterloo


## Contact & Social
- LinkedIn: https://linkedin.com/in/dhillondeep
- Website: https://deepdhillon.ca
- Website: https://github.com/dhillondeep

---
Source: https://flows.cv/deepdhillon
JSON Resume: https://flows.cv/deepdhillon/resume.json
Last updated: 2026-04-01