A Tech Lead on metadata intelligence / data governance, focusing on lineage in Unity Catalog, tagging across databricks products.

Two products i built from scratch:

1, Data Lineage in Unity Catalog: https://docs.databricks.com/aws/en/data-governance/unity-catalog/data-lineage

2, Governed Tags: https://docs.databricks.com/aws/en/admin/governed-tags/

Tech Talk:

Lineage System Table in Unity Catalog - DAIS 2023

Patent:

data lineage tracking: https://patents.google.com/patent/US12242441B1/en

Tech lead of data infra.

• Built the streaming platform (Flink) from scratch, partnered with search, personalization, marketing, etc.

• Built company wide Kubernetes Logging Observability from scratch, re-ramped the log ingestion infra from batch to stream with 99.99%+ SLOs.

• Owner of core mobile (android & iOS) data pipeline (Spark, Hive, Hadoop)

Platform team

• A/B Test

• Email & Notification

Tech talk:

How Houzz Adopted Flink at Scale. Flink Forward Global 2020

Data in fintech