# Sudesh Agrawal

> Software Engineer | Distributed Systems & Data Platform  | Cloud (AWS/Azure/GCP) | Spark | Databricks | Java | Python

Location: Cupertino, California, United States
Profile: https://flows.cv/sudesh

Senior Software Engineering Professional with 15+ years of experience architecting and delivering scalable, cloud-native systems that power analytics, AI, and enterprise SaaS platforms. Skilled in system design, data engineering, and performance optimization. Proven success in modernizing platforms, driving operational efficiency, and enabling data-driven decision-making across cross-functional teams.  

Core Focus Areas:
• Distributed Systems & Data Platform Architecture
• Cloud Platforms – AWS, Azure, GCP
• Analytics & Storage – Snowflake, Redshift, BigQuery, Databricks, Delta Lake
• PostgreSQL, Oracle, MySQL, Nonstop SQL | MongoDB, Cassandra
• Data Engineering – Spark (PySpark, SparkSQL, Spark Streaming), Airflow, dbt, Kafka
• AL/ML Flows – Hugging Face, ML orchestration (Agentic AI, Bedrock, AgentCore)
• Infrastructure & DevOps – Kubernetes, Docker, Terraform, Ansible
• Programming – Java, Python, C/C++, SQL, Bash
• Data Structures, Algorithms & Multithreaded Programming
• Observability, Security, and Compliance
• Server-side Systems – Search Infrastructure, Click Stream Processing, Spider/Bot Control System,
Log Collection and Reporting, Web Application Framework

## Work Experience
### Principal Software Engineer @ SnapLogic
Jan 2018 – Present | San Mateo, CA
● Worked as a key member of multiple Big Data project initiatives including eXtreme, ELT, Push Down Query Optimizer/Generator and AutoSync Data Loader from concept to launch.
● Augmented core Snaplogic platform components and developed new connectors (snaps) to support above initiatives, using AWS EMR, Azure Databricks, GCP and Spark framework
● Led and delivered Enhanced Account Encryption (EAE) feature, vastly increasing customer’s trust
and safety about their data. Led the entire project involving several teams (Platform Engg, Frontend,
QA, Docs) by working closely with Product Management.
● Trained Customer Support/Success teams as EAE requires customer specific AWS KMS
setup/config. Also provided tools to automate migration of existing accounts to EAE, and to perform
periodic KMS Key Rotation. This feature helped sales to win new logos significantly.

### Tech Lead @ Teradata Aster Labs
Jan 2015 – Jan 2017 | Santa Clara CA
● Led the cluster/platform services group responsible for several critical components like Aster
distributed file system, compression module, config/deploy services etc. for Aster analytics platform
● Worked on key initiatives to migrate Aster platform onto Hadoop, Docker and Cloud (AWS and Azure)

### Senior Member of Technical Staff @ PayPal
Jan 2011 – Jan 2015 | San Jose CA
● Worked on Slingshot, a FCGI application fronted by Apache, which routes all site requests (Web and API) to internal PayPal front-end applications. Worked on Routing Engine and Rule Engine
components of the framework.
● Provided optimized data pipeline for collecting and aggregating cookie data for analytics purposes

### Senior Staff Engineer @ Nextag Inc.
Jan 2009 – Jan 2011 | San Mateo CA
● Worked on Search/Cache Infrastructure serving millions of product catalog search queries for 30M unique visitors monthly
● Implemented automated Spider Management System to detect and block unfriendly bots and
crawlers at router and application level
● Provided optimized systems for collecting and aggregating click-streaming data for merchant billing

### Senior Software Engineer @ Yahoo!
Jan 2007 – Jan 2009 | Sunnyvale CA
● Worked on Online Ad data processing pipeline application to process 15+ Billion events/day to track user’s interaction with various types of online ads served on Yahoo ad network. It is used to process data worth $2B+ annually in ad revenue for Yahoo.
● Developed common Execution Framework (yXF), which is used as the underlying platform by all
Yahoo Ad System’s data processing pipeline applications. Worked on Daemon framework, Queue
manager, and Map/Reduce computations components of the framework.
● Delivered impression/click metrics data feeds for advertisers billing, inventory forecasting, campaign planning, and pricing/yield optimization purposes on Yahoo Ad Systems

### Software Engineer @ Tandem/HP
Jan 1999 – Jan 2007 | Cupertino CA
● Implemented multithreaded reader and writer components for ETL plugin, which were designed to
exploit the Linux’s SMP architecture and HP Nonstop platform’s MPP architecture respectively
● Increased HP Nonstop SQL engine’s architectural limits of 2GB per partition of table to 1TB
● Worked on Nonstop SQL file system components in the areas of open processing, real/virtual
sequential block buffering and file label interface. Coded in C, SQL and TACL


## Education
### MS in Electronics Engineering
NIT, Nagpur (Formerly VRCE)

### BS - Electronics and Telecom Engg
COEP Technological University


## Contact & Social
- LinkedIn: https://linkedin.com/in/sudeshagrawal

---
Source: https://flows.cv/sudesh
JSON Resume: https://flows.cv/sudesh/resume.json
Last updated: 2026-04-12