Responsible for serving 60% of company their data needs (Marketing, Finance, Sales, etc.) by maintaining 200+ Spark & Python ETLs on 4-person team using technologies such as Airflow (AWS MWAA), Spark (AWS EMR), Buildkite, Terraform, Presto, Glue, Lake Formation

Led project for removing PII from transcripted sales calls (data from Gong) on ~1 billion words using AWS Comprehend API, Spark Scala, EMR

Led project for creating an internal Chatbot which responds with column-level lineage and high-level explanation of data tables using GPT 4 and Chroma (Vector db)

Go-to partner for Finance team each month for end-to-end calculation of revenue, cogs, and gross margin

On-call rotation member every 4 weeks (24/7) for data infrastructure team

Broadened our analytics team's scope from a single marketing ML model to serving Finance, Marketing, Customer Success, Sales, and Operations. Built out our Snowflake data warehouse from scratch which helped our team expand from 4 to 30 people

Responsible for creating and maintaining Airflow (MWAA) and dbt codebases, and did the initial setup of each

Employee of the Month, Core Value Award for October 2021

Increased data ingestion speed by over 200% by transitioning ClickUp's Airflow server from self-managed EC2 to MWAA using AWS CDK (Python) and multiprocessing

Created office visualization (React, Flask API, Airflow, AWS EB) - a rotating globe of customers - for display on office TVs

Produced video tutorials covering dbt cloud to onboarding analysts/data scientists

Created multiple "scalable webhooks" using AWS CDK (TypeScript, Python): API Gateway -- Lambda -- SQS Queue -- Lambda -- Snowflake

Built a custom integration: Implemented automated refreshes in Tableau extracts based on a successful dbt job run by creating a custom Airflow sensor task and hitting the dbt/Tableau APIs

Created a way to dynamically account for schema changes on ingestion each day, output any schema changes to a central table, then take scheduled snapshots of these schema changes over time

Responsible for most of the API ingestions for the company’s data lake

Happy to help teammates with common issues such as understanding dbt, fixing git issues, creating slack alerts, creating new Snowflake users/roles/permissions, merging PRs, mapping data relationships, reviewing SQL logic, etc.