I worked on the pipeline team which is building out the next generation data ingestion and analysis pipeline. I'm working on a advanced job scheduling system which leverages Airflow by automatically building pipelines out of metadata associated with the pipeline pieces.

Extending a Confidential Piece of software