San Francisco, California, United States
Software engineer on the Archiving & Data Services team.
• Prototyped, built, and maintained fullstack features for a suite of web crawl data sites. Features included user management, search (keyword, faceted, predictive), caching, persisting and monitoring job run data, and custom interface design for displaying web collection metadata.
• Developed infrastructure and platform improvements across multiple applications, including deployment playbooks, QA sites, CI/CD workflows, and performance monitoring.
• Applied security updates to code repos/internal processes after a major data breach and outage.
• Ran custom data analysis on petabytes of archival web data for partner research requests.
• Technologies: Python, Django, TypeScript, Lit, Angular, PostgreSQL, Scala, Spark, Hadoop, Solr, Elasticsearch, Ansible, Docker.