Internal Tools and Services Team
•Developed a smart scheduler as a service for all incoming test requests in Cloudera’s testing infrastructure pipeline. The scheduler was optimized to both lower datacenter costs as well as provide features for halting test runs based on downstream infrastructure failures.
•Learned how to deploy a service required to handle thousands of large business critical requests throughout the day as well as how to navigate the human side of creating internal tools (reluctance to adapt to new requirements, how to handle SLAs).
•Learned how to properly containerize and write end to end tests using Docker and testing frameworks to automate the deployment and testing of a service.
•Learned to navigate a large code base consisting of both closed source (internal tools, build systems, etc.) and open source projects (Apache Hadoop, Impala, Spark, etc.).
