# Tong Wu

> Staff Software Engineer @ ByteDance | GPU Serving, Optimization, Recommender Systems

Location: Fremont, California, United States
Profile: https://flows.cv/tongwu1

## Work Experience
### Staff Software Engineer @ ByteDance
Jan 2022 – Present
*Developing and contributing to TikTok’s global scale distributed GPU-serving infrastructure for recommendation systems, improving throughput, reducing latency and enhancing reliability.
*Designed and contributed to the key GPU model serving optimization solutions, including MLIR-based automatic operator fusion compiler, GPU kernel development, resulting in tens of millions of dollars in cost savings annually.
*Collaborated with Rank, Ads, E-commerce and many other business teams in model inference optimization, enabling the successful launch of critical models and algorithms.
*Enhanced the serving infrastructure to enable business teams to scale up their models strategically, driving significant impacts and results.
*Introduced and deployed the in-house developed AI hardware accelerator in non-China region; developed further optimizations.
*Introduced vLLM based LLM serving to meet in-house business needs.
*Mentored new engineers.

### Cofounder @ DinoplusAI
Jan 2017 – Jan 2017 | San Francisco Bay Area
DinoplusAI designs AI processors and the software to run them in data centers. Our unique approach optimizes for inference with the focus on performance, power efficiency, and ease of use; and at the same time our approach enables cost-effective training.

### Senior Technical Lead @ Cisco / Insieme Networks
Jan 2013 – Jan 2017 | San Francisco Bay Area

### software development engineer @ Lab126
Jan 2011 – Jan 2013

### Senior Manager of Software @ Capsovision
Jan 2008 – Jan 2011

### Senior software engineer @ SiS
Jan 2007 – Jan 2008

### Senior Software Engineer @ ESS Tech
Jan 2003 – Jan 2006

### software engineer @ Divio
Jan 2001 – Jan 2003


## Education
### Shanghai Jiao Tong University


## Contact & Social
- LinkedIn: https://linkedin.com/in/tong-wu-66a6a61

---
Source: https://flows.cv/tongwu1
JSON Resume: https://flows.cv/tongwu1/resume.json
Last updated: 2026-04-12