Sundara Raman Ramachandran

Sundara Raman Ramachandran

Sundara Raman Ramachandran

LLM Inference/Recommendation Systems @ LinkedIn | Staff Engineer | SGlang Contributor | UT Austin

📩 Feel free to reach out to me at 𝐬𝐮𝐧𝐝𝐚𝐫𝟐𝟒𝟐𝟗𝟓@𝐠𝐦𝐚𝐢𝐥.𝐜𝐨𝐦 I regularly speak, write, and collaborate on 𝐋𝐋𝐌 𝐢𝐧𝐟𝐞𝐫𝐞𝐧𝐜𝐞, 𝐫𝐞𝐜𝐨𝐦𝐦𝐞𝐧𝐝𝐞𝐫 𝐬𝐲𝐬𝐭𝐞𝐦𝐬, and 𝐀𝐈 𝐢𝐧𝐟𝐫𝐚𝐬𝐭𝐫𝐮𝐜𝐭𝐮𝐫𝐞.

Experience

SGLangContributor

2025 — Now

2025 — Now

Contributed performance and API improvements across tokenization, batching, scoring, and benchmarking in the SGLang LLM serving framework.

1. Tokenizer: Batch tokenization and dynamic batching

https://github.com/sgl-project/sglang/pull/5141

https://github.com/sgl-project/sglang/pull/9382

2. ZMQ Pipeline: Batched send from Tokenizer Manager

https://github.com/sgl-project/sglang/pull/9436

3. Generative Score API: Removed decode path, optimized prefill-only scoring, added multi-item scoring with custom attention masks

https://github.com/sgl-project/sglang/pull/8840

https://github.com/sgl-project/sglang/pull/9748

https://github.com/sgl-project/sglang/pull/10979

4. Benchmarking: Prefill-only benchmark scripts

https://github.com/sgl-project/sglang/pull/10240

LinkedInStaff Software Engineer

2025 — Now

2025 — Now

Mountain View, CA

LLM Serving Infra (on-prem and cloud) @ LinkedIn

LinkedInSenior Software Engineer

2022 — 2025

2022 — 2025

Sunnyvale, California, United States

LLM Serving Infra (on-prem and cloud) @ LinkedIn

MicrosoftSoftware Engineer 2

2021 — 2022

2021 — 2022

Redmond, Washington, United States

Member of Azure Identity and Access Management team.

Working on RBAC Authorization service.

The University of Texas at AustinGraduate Teaching Assistant

2019 — 2020

2019 — 2020

Austin, Texas Area

Graduate Teaching Assistant at the Computer Science department.

Education

The University of Texas at Austin

MS

College of Engineering, Guindy

Undergraduate

Smt. Ramkuwar Devi Fomra Vivekanda Vidyalaya, Chromepet, Chennai.

Higher Secondary