# Shashank Reddy

> Data Engineer

Location: United States, United States
Profile: https://flows.cv/shashankreddy

Data Engineer with extensive experience designing, developing, and maintaining Extract, Transform, and Load (ETL) pipelines from diverse data sources. Proficient in data governance, data lifecycle management, and real-time data processing. Skilled in collaborating with cross-functional teams to optimize systems for high performance and reliability. Strong expertise in big data ecosystems, cloud platforms, and machine learning tools, enabling scalable and data-driven solutions.

## Work Experience
### Founding Engineer @ Airfold
Jan 2025 – Present | San Francisco, CA
- Architected multi-cloud platform (AWS/GCP) using Terraform, EKS, and Istio, ensuring high availability for 50+ services and enhancing system resilience.
- Engineered event-driven pipeline (Kafka, Debezium CDC, ClickHouse) processing millions of daily events with sub-second latency and exactly-once semantics.
- Developed 100+ production-grade FastAPI endpoints with robust Auth0/RBAC security, serving as the backbone for scalable client interactions.
- Integrated dbt into the ELT pipeline to standardize transformation logic in Snowflake & ClickHouse, reducing reporting errors by 40% via automated quality tests.
- Managed multi-database architecture (PostgreSQL, DynamoDB, ClickHouse), optimizing storage for vector search, caching, and large-scale analytics.

### Data Engineer @ Kantar
Jan 2020 – Jan 2022 | Bengaluru
- Orchestrated ELT pipelines using Airflow and Spark, integrating Kafka streams to ingest advertising data with exactly-once semantics.
- Accelerated data modeling by deploying dbt for complex SQL transformations, replacing ad-hoc scripts with modular pipelines that reduced time-to-insight by 25%.
- Designed real-time processing framework with Kafka Streams and Spark Streaming, providing near real-time insights into campaign performance.
- Deployed serverless architecture (**AWS Lambda, S3**) to automate data workflows, reducing manual intervention by 80% and improving reliability.
- Engineered ROI optimization algorithms that increased client sales by 34% for global enterprises through data-driven ad spend allocation.

### Data Engineer @ The Sparks Foundation
Jan 2018 – Jan 2020 | Bengaluru, Karnataka, India


## Education
### Master's degree in Data Analytics
San José State University

### Post Graduate Diploma in Data Science
International Institute of Information Technology Bangalore

### BE - Bachelor of Engineering in Computer Science
Visvesvaraya Technological University


## Contact & Social
- LinkedIn: https://linkedin.com/in/shnkreddy

---
Source: https://flows.cv/shashankreddy
JSON Resume: https://flows.cv/shashankreddy/resume.json
Last updated: 2026-04-05