Experience
2024 — Now
As I chose to leave management, search and storage split into a streaming team, and our next-generation storage layer, Events Analytics Platform (with a similarly named team).
• Migrated ingestion for our most important dataset, errors, onto our unified platform. Extended our existing ClickHouse deletion system to handle much larger data sizes
• Built out a “jobs system” for executing privileged one-off jobs in production without compromising user privacy. This included some light design, gathering requirements, execution, and assisting a junior engineer in implementation
Result: has helped the team resolve high-urgency incidents, positive feedback for ease of use and simplicity
• Guide more inexperienced employees in the technical intricacies of the systems we own, as well as general software engineering hygiene and professional social structures
• Researching solutions to a forced-consistency system we built called the “optimize job”, which has become unreliable over time
• As a result of the aforementioned “optimize” work, deep diving ClickHouse merge internals and presenting results to the team
• Delivered learning session on the subscription system which powers Sentry alerts, while also making changes to increase its reliability
2023 — 2024
2023 — 2024
• Provided guidance for engineers on how to get unblocked
• Handled escalations when our team was backed up behind dependency teams
• Upward reporting and estimations for long-running initiatives
• Executed performance reviews and delivered feedback to my reports on a regular basis. Guided 3 reports into promotion into the next level
• Owned the on-call process for the storage team
2021 — 2023
The search and storage team built APIs and ingestion consumers that power some of Sentry’s most important data-driven experiences. The underlying database is ClickHouse and we are responsible for both making sure the fleet is properly configured and building abstractions so that product teams can build without being ClickHouse experts.
• Worked with a staff engineer to design and implement a low-cardinality metrics storage system based on ClickHouse. This was the basis of “dynamic sampling”, an early iteration of Sentry’s performance product
• Helped the team define on-call rituals, drawing from pager rotation experience at Amazon
2018 — 2021
2018 — 2021
• built out APIs and data ETL for serving "musical memories"; a feature that supported a "your year in review" widget in visual Amazon Music clients
• designed data schema, built out data pipeline, and developed APIs to support a weekly "My Discovery Mix" playlist that goes to millions of Amazon Music customers every week
• worked on C++ desktop client changes to support enhanced playlist functionality
• built out new Java-based API service in support of a "My Likes" playlist, with the goal of replacing legacy playlist API service
• contributed to playlist import project on TypeScript-based Lambda-served external API
• member of on-call rotation that handles operational burdens for recents, playlists, and GDPR compliance for all of Amazon Music
• reviewed dozens of project plans/proposals from my team and adjacent teams
• currently building playlist features for the "Curate Experience" team
2014 — 2018
* redesigned and re-wrote our subscription accounting system to be more correct and reliable
• ported a ruby/python application to combine image annotations to Java and AWS Lambda, to make the process automatically scalable and much cheaper to execute (in infrastructure costs), simplified logic and added documentation in the process
• proposed and created prototype implementation of ETL process to get production (PostgreSQL) data into our preproduction testing environments, now being put in practice
• worked with product team to design, develop, and test new features on complex customer facing product
• designed complex queries for data warehouse to test feasibility of new features/product ideas
• reviewed multiple Ruby on Rails and SQL code patches/day
I also helped put into place processes for:
* how defects are reported, by less technical staff
* the rotation of watching the "firehose", our bug reporting system
Education
San Francisco State University
Masters
University of Central Florida