Software engineer on the Archiving & Data Services team.

• Prototyped, built, and maintained fullstack features for a suite of web crawl data sites. Features included user management, search (keyword, faceted, predictive), caching, persisting and monitoring job run data, and custom interface design for displaying web collection metadata.

• Developed infrastructure and platform improvements across multiple applications, including deployment playbooks, QA sites, CI/CD workflows, and performance monitoring.

• Applied security updates to code repos/internal processes after a major data breach and outage.

• Ran custom data analysis on petabytes of archival web data for partner research requests.

• Technologies: Python, Django, TypeScript, Lit, Angular, PostgreSQL, Scala, Spark, Hadoop, Solr, Elasticsearch, Ansible, Docker.

Backend engineer on the Publisher Content Management team.

• Built and maintained ETL pipelines for processing publisher payouts and ingesting metadata for millions of ebooks, audiobooks, podcasts, and sheet music documents.

• Migrated 10+ nightly processing jobs from an on-prem stack using Ruby/Scala 2/Hive/Hadoop to an AWS cloud stack using AWS/Airflow/Spark/Scala 3.

• Built internal fullstack apps and dashboards to monitor and manage data and processes.

• Contributed to planning, designing, code review, process improvement, and feature delivery.

• Technologies: Ruby, Ruby on Rails, Rspec, Javascript, Airflow, Spark, Scala, AWS, Databricks.

• Managed a collection of 19,000+ artifacts, including working with a large database of artifact metadata.

• Developed a system for preserving the museum’s contemporary, technology-based art collection. Wrote python scripts to generate checksums and extract metadata from artwork files, backed up files and code, managed the backup archive, ran fixity audits, and wrote technical documentation.

• Managed the JIRA database for photography project tracking. Coordinated and scheduled artifact photography for 500+ artifacts/year.

• Examined, documented and conserved/restored 3000+ artifacts.

• Carried out x-ray fluorescence, x-ray, and cross section analysis of select artifacts.

• Worked across three museum sites (the deYoung Museum, Legion of Honor, and SFO Airport Museum) on a range of materials: wood, plaster, metal, stone, ceramic, glass, gilded surfaces, plastic, rubber, paper, textiles, natural history, and composite objects.

Major/favourite projects:

• Conserving the Salon Dore: an eighteenth-century French period room at the Legion of Honor.

• Conserving ~60 large-scale Tushanwan wooden model pagodas from the 1915 Panama-Pacific International Exposition.

• Conserving ~70 air hostess uniforms and fashion accessories for the Fashion In Flight: A History of Airline Uniform Design exhibition.

• Rehousing ~100 model aeroplanes and flight carry on bags.

• Carried out earthquake disaster recovery work following the February 2011 Christchurch earthquake.

• Restored 100+ earthquake-damaged artifacts, primarily Greek and Roman archaeological ceramics.