# Shivani Agrawal

> LLM, Gemini, PALM at Google. 
Co-lead Algorithmic Efficiency for Gemini/Gemma Models.

Location: San Francisco Bay Area, United States
Profile: https://flows.cv/shivaniagrawal

My expertise lies in optimizing algorithm efficiency through techniques such as compression (quantization/sparsity) and distillation. I've spearheaded teams in core research, contributing to multiple patents and publications in these domains, and successfully scaled these techniques for Gemini models in production. Additionally, I've actively contributed to hardware-software co-design initiatives aimed at enhancing inference and training efficiencies for future TPU generations.

## Work Experience
### Staff Software Engineer @ Google
Jan 2017 – Present | Mountain View
2025: Gemma 3n launch; led model co-design efforts, focusing on efficient on-device model performance.
2023-2024: Spearheaded hardware-software co-design for TPU, optimizing inference and training efficiency; deployed efficiency techniques for a wide set of Gemini models.
2022-2023:First generative AI for mobile (led model compression to achieve optimal memory/latency-quality for the model).
2022: Developed efficient inference for transformers, quantized PALM, and co-led the effort to launch it into the first product.
2019-2024: Conducted research in quantization/sparsity for transformers, launching inference-efficient techniques for Translate models. Developed a compression library to enable research at production at scale scalable. Contributed to hardware/software co-design, implementing multiple efficiency features across several TPU generations.
2017-2019: Core developer for Tensorflow and efficient TPU runtime infrastructure.

### Summer Internship @ BloomReach
Jan 2016 – Jan 2016 | Mountain View

### Senior Software Engineer @ Samsung Research Institute
Jan 2014 – Jan 2015 | Bangalore

### Research Scholar @ Carnegie Mellon University
Jan 2013 – Jan 2013 | Pittsburgh, Pennyselvania

### Software Engineer @ Finisar Corporation
Jan 2012 – Jan 2012


## Education
### Master's degree in Computer Science
UC San Diego

### Bachelor's and Master's degree in Electrical and Electronics Engineering
Indian Institute of Technology, Kanpur


## Contact & Social
- LinkedIn: https://linkedin.com/in/shivani-agrawal

---
Source: https://flows.cv/shivaniagrawal
JSON Resume: https://flows.cv/shivaniagrawal/resume.json
Last updated: 2026-04-12