I'm a Senior Software Engineer at Modular, working on Mammoth 🦣 — a heterogeneous, distributed inference system designed to serve large models efficiently at scale across any hardware.