• Designed and implemented a database solution to store autonomous vehicle sensor measurements for creating high definition (HD) maps.

• Created a version control and data lifecycle management solution for updating HD maps.

• Created large scale batch data processing pipelines for ads data.

• Worked extensively on troubleshooting and query optimization for Presto and Spark SQL, gained deep understanding of MPP database.

• Set up A/B testing experiments to analyze impact of individual features

Worked on data warehouse construction, and database performance improvement

• Designed and Created data warehouse tables, and implemented both batch ETL solution using Airflow and streaming ETL solution using Kafka Streams

• Created indexes and analyzed query execution plans to optimize SQL queries

• Designed and created views to provide abstraction over tables

• Analyzed query pattern from DB logs to provide suggestions for data warehouse design

Developed machine learning pipeline with Airflow:

• Worked with statisticians to build machine learning model using Scikit-learn and Stan

• Created machine learning pipeline related data schema using Avro

• Extracted data using SQL query, and applied complex data transformation using Pandas

• Stored model prediction and parameters to S3, and retrieved with Athena