Software Engineer with experience in building and supporting highly scalable systems.
Experience
2019 — Now
2019 — Now
San Francisco Bay Area
Lead Staff Engineer for Lyft's Partners org which owns B2B products, platforms & integrations.
Focussing on long term vision & reliability of the services and products owned by our teams to help build a robust, enterprise-grade product, invoicing and user management XPs for Lyft's B2B partners.
Previously, worked on Lyft’s Observability team, where I was instrumental in launching Lyft’s new Logging pipeline to ingest Lyft’s service logs and make it available for querying and analysis. Earlier, I worked on a feature to enforce structured logging on Lyft service logs, that helped save the company ~2.4M$ per month.
AWS - Kinesis, SQS, Lambda, DDB, Flink, Kakfa, fluent-bit, fluentd, Elasticsearch, Kibana, Python
2016 — 2019
2016 — 2019
San Francisco Bay Area
Lead and Manage ipsy’s Data Infrastructure team of 7-8 engineers
Lead the team to build ipsy’s
• Internal Pub-Sub system based on AWS Kinesis to support real-time use cases for ipsy CRM and E-Commerce efforts.
• A/B testing system used heavily by the ipsy website, apps and personalization framework.
• Event Tracking pipeline that collects metrics for key events like signups, subscriptions, purchases, clicks and page views. Pipeline supports realtime and batch use-cases.
• Fact-Stores containing dimension and fact tables for ipsy's personalization and analytics team to support feature-set creation for building personalization models and reporting.
• Airflow as ipsy's ETL system that all engineers and analysts contribute scheduled jobs to.
• Pipelines to support Ads reporting, Funnel analysis, CRM
I was also instrumental in setting up
• Databricks as a Data processing platform for internal use. I was involved in comparing Databricks with EMR during the POC phase and later created and conducted a set of training sessions to train 20-30 engineers and analysts in Spark and Databricks.
Technologies
AWS - Kinesis, Redshift, Glue, EMR, SQS, Lambda, Athena, Datapipeline
Apache Spark (Scala, Java and Python), SQL, Airflow
Spring Boot, Grails
2014 — 2015
2014 — 2015
San Francisco Bay Area
Full stack and Data engineering
• A/B testing
• Event Tracking and Pipelining data into Redshift
• Dimension and Fact modeling
• CRM
Technologies
AWS - Kinesis, Redshift, Glue, EMR, SQS, Lambda, Datapipeline
Apache Spark (Scala, Java and Python), SQL
Grails, Spring Boot
Angular JS
2013 — 2014
2013 — 2014
Work on Zynga's Analytics Engineering team. Currently own and work on Zynga's data logging and real time analytics services which handles on average 10B records a day, and is highly used by all Zynga games. It's currently the backbone of Zynga's Analytics platform.
2013 — 2013
2013 — 2013
Working on Zynga's Analytics platform. Currently own and work on Zynga's data logging and real time analytics system which handles on average 10B records a day.
Education
University of Florida
Master of Science
University of Mumbai