Infra

Implementing a Kubernetes-as-a-service platform based on EKS, providing self-service cluster deployment. Implemented a data discovery service using Amundsen, a centralized metadata engine deployed in our EKS cluster, and Airflow service for scheduled data ETL pipelines and reporting jobs. Built CI/CD pipelines using CircleCI and data infrastructure tasks, including DBT pipelines, data ingestion, data warehouse management, and an automated chat system with ChatGPT and Pinecone.

Core infrastructure team

developing an infinitely scalable database system using Vitess, providing features like horizontal sharding and auto-failover. Created a high-availability MySQL database cluster with advanced monitoring and alerting. Additionally, built a secret management system using Vault for role-based access control and encryption, and a service-discovery system for EC2 and Kubernetes clusters using Consul. Integrated Kubernetes networking with backend services using Istio and contributed to infrastructure improvements involving Haproxy, Redis, Zookeeper, TSDB, Ganglia, Bosun, and security projects.