lead the overhaul our data pipeline - isolating data extraction from transformation & loading, consolidated the ingestion of over 200 collectors

migrated unstructured data out of PostgreSQL to Amazon S3 mitigating costs by 10%

used NLP and Pydantic models to automate extraction and normalization producing structured data within parquet files

leveraged dashboards within Databricks and Looker to provide data insights to customers and analysts

create and maintained over 100 collectors for diverse data formats, including csv, pdf, api, and html:

used web scraping libraries and frameworks such as BeautifulSoup, Selenium, Playwright

handled anti-scraping mechanisms like CAPTCHAs, rate limiting, and IP blocking

Used retries, multiprocessing, and parallelization techniques to enhance runtime

Made front-end changes with feature toggles to ensure smooth deployment and used Jenkins for automated build/continuous integration

Established over 98% test coverage with Jest's snapshot and unit testing for React application

Developed features within sprints following agile methodologies

Utilize assistive technology such as screen readers to perform testing on company applications to assure WCAG Level AA Web Content Accessibility and documented defects in Rally

Learned the importance of accessibility for all - especially so for individuals with disabilities and made a presentation about my learnings

Supported QA Engineers and Developers on what to look for and how to code for accessibility

Learned and assisted in carrying out the Product Owner role leading meetings helping capturing information needed to prioritize work

Integrated data from wearable devices into an existing dashboard that maintains and monitors the wellness of members to increase the accuracy of its member stratification algorithm

Used Safe Agile to create/prototype a new dashboard that would display wearable technology data using Tableau

Automatized alerts that will help Care Managers reach out to members that are stratified as high risk to maintain their wellbeing

Developed a Business case with a team of five and presented our work to employees of Aetna

Produced documentation for the implementation of the new backup system - Fixed over 8000 redundancies and inconsistencies in Con Edison’s work managing database saving the company over 6 million dollars

Presented work in front of Vice President of System & Transmission Operations Water Alvarado, Dr. CERO, Brooklyn Tech Alumni Foundation Dr. Matthew Mandery, and other Con Edison Employees

Familiarized with Visual Basic and SQL through Microsoft Access