Implemented server-less architectures with AWS Lambda to automate and streamline data processing and data pipelining tasks, including event-driven updates and integration with external EdTech systems like Clever, ClassLink, Edlink and OneRoster.

Designed and optimized relational databases in MySQL, managing and querying data related to user profiles, class assignments, and scheduling, resulting in improved data retrieval times and system efficiency.

Worked with Devops teams to set up HoneyComb tracing and setup AWS Cloudwatch dashboards for monitoring improving observability into Data platform.

Refactored and cleaned up legacy code within the rostering data pipeline to improve maintainability and pipeline ingestion performance, ensuring compatibility with modern technologies and reducing technical debt.

Used DBT to transform data from various sources such as transactional databases, API’s into clean, analytics ready datasets.

Used Python to clean, wrangle unstructured data in varied formats such as ACH, API logs.

Helped implement and maintain ETL jobs for our Snowflake data warehouse with dimensional modeling.

Developed interactive dashboards using Looker to visualize key metrics and enhance data driven decision-making.

Automated critical data processing workflows by orchestrating pipelines with Airflow, improving scheduling efficiency and reducing manual intervention.

Designed and implemented scripts for legacy data ingestion from external sources like AWS S3 and FTP servers, using Pandas for data cleaning and transformation.