• 12+ years experience of design and build large distributed service. • Experience in big data, cloud computing technologies and microservices • Solid programming skills in Java and GO • Leading and empowering engineers to deliver impactful results
Experience
2022 — Now
2022 — Now
San Francisco Bay Area
Data platform team:
Tech lead for multiple cross team projects including:
Lead a group of 4 engineers, designed and delivered Data Quality Observability Platform: A unified solution for observing and detecting offline data anomalies at Coinbase.
Lead a group of 2 engineers, designed and built Query Builder Service, acting as a query gateway to various databases and data warehouses. This service supports synchronous and asynchronous calls, caches query results, manages table-level user access, and utilizes the Apache Arrow data format for increased efficiency.
Also Designed and built Data Asset Ownership service, Config Management Store, Data Asset Tiering system, Data Profiling and Data Parity service.
2018 — 2022
2018 — 2022
San Francisco, California, United States
Data platform team
Tech lead for multiple projects, build big data ingestion pipelines (ingestion service, Kafka, Hive, ELK, M3) and platform for analytic events (UBER rider, driver, eats, freight and web), build real-time data aggregation (Flink) and off-line data aggregation (Spark) for providing real-time, daily and weekly aggregated views, improving data quality and efficiency by anomaly detection, reducing data storage cost (Hive). Build platform for managing analytics events meta data, ownership, lifecycle, tiering and created quality gates for preventing regression.
Cloud Infrastructure team
Build virtual private cloud on Amazon web services and Google cloud platform for Uber into the next 10x-100x growth levels. Bootstrap a bare metal for application team to use.
Marketplace Platform team
Build Marketplace Platform Gateway API, serves millions of QPS for UBER traffic and provide middle-ware (Auth, Caching, Geo-Location)
2017 — 2018
2017 — 2018
Bellevue, Washington, United States
VMware Cloud Services on AWS, the service will integrate the capabilities of our flagship compute, storage, and network virtualization products (vSphere, vSAN, and NSX), along with vCenter management, and optimize it to run on next-generation elastic, bare metal, AWS infrastructure.
http://www.vmware.com/cloud-services/vmware-cloud-aws.html
https://aws.amazon.com/vmware/
2015 — 2017
2015 — 2017
Redmond, Washington, United States
Azure Compute, Service Fabric
Service Fabric: building Service Fabric to leverage Azure nodes roll-out customer payloads to their own virtual machines
Azure Active Directory, Gateway
Gateway is the reverse proxy which is front door to Microsoft's identity services. It is highly available service and a platform service for Identity services.
• Corporate with partner team, lead, design and implement workflows to auto-install customer domain certificates and bindings at Gateway Service on the fly. This project would bring additional millions of traffic per minute to Gateway Service and would be a new Azure Active Directory feature on Azure Portal.
• Implement multiple critical features to improve Gateway service performance and availability to 99.999% which including multiple ways of failover endpoints and data centers, multiple options of retry logic, improving cache performance.
• Implement multiple important features to improve configuration service performance including integrating with dependent service for logs auditing, improving concurrency and thread safe fault points.
• Handle critical live site issue for 2 million request per minute for Gateway Service as a dev-ops model including on-call, bug fix, customer QAs and educations.
2013 — 2015
2013 — 2015
Seattle, Washington, United States
• Mobile Ads team
• Build service to help developer rendering Ads on mobile devices
• Warehouse Deals team
• Build service to support global Amazon fulfillment center
Education
New York University
Master
Beijing University of Technology