Tools and Infrastructure team: Built, maintained, and improved a wide range of tools used by the software development team as the company scaled from 100 engineers to 1000+ engineers. This includes automated systems to build, and test over 1000+ packages.
Recent projects include:
Creation of a distributed caching layer for build system for intermediate and final build products, used to accelerate builds on a cluster of 200+ build servers. A Varnish cache cluster using SSD handled the bulk of the traffic. A cluster of golang servers handled all uploads of new objects and fetches for objects not in the cache. Objects were stored in a swift cluster, and the mappings between the objects stored in MySQL.
• Build/test log storage infra that provided local caching for most recent log, while long term storage used Google Cloud Storage for long term archival.
• Setup kickstart infrastructure to bring up new machines in build/test cluster.