End to end migration from managed azure synapse to self managed clickhouse, including CI/CD deployment, monitoring and pipeline development. This ended up saving thousands of dollars for the organization.

Developed multiple data pipelines to faciliate collection of retail media advertising related metrics using ADF, pyspark and databricks. The data was then used for dash boarding, reporting and analytical purposes.

Designed autograder for the course using python frameworks. Formulated assignments. projects and homeworks which take a deep dive into the world of big data and data science techniques.

Implemented multiple time series models such as Prophet and Sarimax and deployed them as micro-services. Used REST principles to enable communication between the web application and the machine learning models.