Working on large scale distributed data systems to protect consumer data (Data Governance, metadata management).
•
Designed and maintained high-performance backend services powering Capital One’s data governance platform used by 100+ internal teams, processing petabytes of data across AWS (S3, DynamoDB, RDS)
•
Redesigned legacy batch workflows into an event-driven, real-time data pipeline using Spark, AWS Glue, EMR, and Lambda, improving reliability and reducing metadata ingestion latency
•
Optimized Spark and AWS Glue jobs to scale from 1 TB in pre-prod to multi-petabyte workloads in production, improving performance and lowering infrastructure cost
•
Led end-to-end service architecture from design and implementation to observability, using OpenTelemetry to enable proactive monitoring and improve data quality
•
Collaborated cross-functionally with data platform teams, internal customers, and product to ensure data quality, regulatory compliance, and seamless integration with enterprise systems
Software engineer on Twitterʼs Auth Platform team working to protect userʼs data. Work with distributed systems at scale impacting millions of users.
•
Designed and built cost optimization improvements for our infrastructure for Authorization services, and helped save > $700K per annum.
•
Implemented features related to OAuth2 flows for all Twitter requests, system to tamper proof authentication data, centralized auth solution for all external requests, Twitter Single Sign On, and identity provider.
•
Improved services with cache optimizations, feature limits to reduce spam, and make services FTC-compliant.
•
Performed on-call duties including maintenance of teamʼs services, address customer questions and requests, manage service deployments and incidents, and debug issues related to service.
Interned on the AWS Serverless (Lambda, SNS, API Gateway, Step Functions, SQS, Event Bridge) team during Winter 2020
•
Built internal tool, saving a 1000+ hrs per annum for the team, to automate creating, queuing, prioritizing, and tracking deployments made to AWS Serverless services across various regions.
•
Full-stack project built with React, DynamoDB, Python/ Flask, and AWS SNS. Designed, architected, and implemented the solution using distributed system principles.