Responsible for collecting all information about vulnerabilities to software products as reported by security agencies, vendors and other 3rd parties. This requires maintenance of a set of 30+ web parsers with custom logic that consume & structure web content for downstream processing as well as development of new parsers that provide even more verified data for the product to work with.
Interface with a variety of cloud/data technologies and improve processes by investigating new processes and use-cases (AWS, Python, Gitlab, Kubernetes, PostgreSQL, Redis, Kafka, Apache Airflow, Apache Spark, Snowflake, ElasticSearch, Delta Lake, Prometheus/Grafana)
Maintain portion of ML streaming pipeline (using kafka and python3) to relate vulnerability information to products and enable big data aggregations (using airflow/spark) and ML inferencing with this data.
Responsible for the accuracy and timeliness of critical product data. By extension, need to work very closely with customer success to resolve any customer concerns about the accuracy of the product as quickly as possible. Demonstrated a level of ownership that was recognized as a primary reason for my 2023 promotion.
Worked with a growing team with mixed responsibilities, and required to assist in developing code for use outside of my typical responsibilities (or typical working hours).