Crafted batch data pipelines, leveraging AWS Glue (Apache Spark, Python) and AWS Batch, to wrangle data from diverse internal and external sources.
Facilitated the marketing team in optimizing advertisement campaign portfolios. Designed data pipelines capturing performance metrics from various sources, including Google Ads, Facebook Ads, and Bing Ads.
Designed and implemented CI/CD processes for efficient deployment and testing of ETL jobs. Utilized AWS CloudFormation, CodePipeline, and AWS Lambda for streamlined automation.
Engineered automation for executing AWS Athena queries on the Glue catalog (S3 buckets - parquet data format) and sending daily reporting results to relevant stakeholders for informed decision-making.