Dynamic Senior Data Engineer with a strong full-stack and mobile development background, specializing in building and scaling robust data platforms and driving cost-saving initiatives. My expertise lies in designing and implementing end-to-end data solutions using Snowflake, dbt, Airflow, and Kafka.
Spearheaded the design, development, and migration to PRISM, a new large-scale data platform utilizing Snowflake, Kafka, AWS MWAA (Airflow), Fivetran, and dbt.
•
Architected and scaled core dbt projects to over 3000 models and Airflow projects to over 1000 DAGs,
establishing robust data transformation and orchestration frameworks from scratch.
•
Championed and implemented a company-wide data retention policy, successfully removing 25% of entire Snowflake storage
•
Achieved Snowflake SnowPro Core Certification, demonstrating expertise in Snowflake data
warehousing
•
Developed and enhanced automated flattening and bulk stitching solutions for Kafka-ingested data, scaling to process 500+ tables and ensuring data consistency and reliability
•
Automated critical cost reduction and data cleanup processes, including stakeholder notifications,
enhancing operational efficiency and data governance
•
Managed Snowflake infrastructure using Terraform and developed robust CI/CD pipelines for dbt and
Developed and published a cross-platform responsive mobile application for edChain, an open source decentralized library that allows the sharing of educational content across applications and organizations
•
Consuming multiple RESTful APIs to get course data from thousands of MOOCs
•
Render data into robust, performant and reusable react-native components
•
Developed an extensive search functionality and In-App browser support across all courses in the app
Developed and published a cross-platform responsive prototype mobile app for career and education platform.
•
Platform allows students to develop skills, apply for jobs and recruiters can view candidate’s profile and perform skills evaluation. It has components like Animated Bar graphs, Drawer, Cards, Checklists, Articles, Videos etc.
•
Technologies used : react-native, react, node.js, JSON, Sketch, Android
