Productionizing GenAI at scale:
● Helping build company-wide strategy and platform for LLM's and GenAI. "Founding engineer" of GenAI enablement team.
● Partnering with product marketing and seller teams to initiate applications of GenAI. Productionized first agentic application in Langgraph.
● Drove engineering from prototype to production applying GenAI to improve Search Engine Optimization, conducting LLM-based image caption generation across hundreds of millions of listing images. Increased sales volume (GMS) by $25 million.
● Built a no-code tool that enables product experts to prototype and evaluate GenAI use cases.
Cost-efficient and Easy-to-use Machine Learning Platform:
● Tech lead for team focused on ML model serving and inference
● Developing scalable and cost-efficient ML model serving platform, supporting hundreds of models at hundreds of thousands of requests per second.
● Led product for automatically recommending configurations for ML model serving. Saved over $23.2 million GMS and reduced ML model deployment time from ~2 weeks to ~2 hours.
