Foundational Data Engineering team (4 years)
Worked on team responsible for critical data loading pipelines which ingested foundational financial data (e.g. prices, security master, etc) into the company for use by all trading models and back office operations. 30-40 team members, often divided into sub-teams of 5-10.
Languages: Java, Python, SQL, Bash
Select technologies: SQL Server, Jira, Git, Kubernetes/Docker, Jenkins
Select responsibilities:
* Involved in more than a dozen data pipelines. Work included researching vendor files and business partner requests to determine requirements, development of new pipelines, maintenance and improvement of existing pipelines, supporting pipeline operations, and deprecating pipelines when no longer needed.
* Seek ways to improve software quality and reduce operational risk. Innovated on CI/CD practices, especially driving development of integration testing. Sought consensus among software engineers on the team on how to best write software, from small issues like using local variable type inference in Java to large issues like whether or not to adopt code autoformatters.
* Participate in over a 1000 code reviews from teammates. Lauded for speedy and diligent reviewing with useful feedback.
* Handled L2 on-call support for the team one week every 3 months. Able to quickly investigate incidents, find root causes, and create patches to maintain speedy delivery of data.
* Mentored newer teammates. This includes teaching software engineers about the development environment and best practices as well as guiding data analysts on basics of software construction. Further spread knowledge by giving brown-bag style talks on many topics, such as Python’s asyncio library.
* Managed the team’s summer intern on two occasions, driving both to successfully complete projects which added value to the team. Both received return offers.
