Founding engineer on Confluent Cloud Fleet Management (Control Plane) -- designed, developed, and deployed scalable solutions for day 1+ operations on all Confluent Cloud clusters including:
• Workflow engine to replace manual dataplane upgrades across the fleet for any cluster type (Kafka, KSQL, etc) and any operation (Upgrade, Restart, Shrink, etc) --> reduced fleet wide rollouts from a 1-2 month endeavor to a 1-2 day task.
• Microservice deployment engine to eliminate manual Helm based deployments and handle Confluent's scale of 10000+ deployments/day
• Microservice to aggregate data from multiple sources via change-data-capture pipelines, database queries, and API scraping so engineers have a unified view of the entire fleet --> Accompanied by a ReactJS based UI for better visibility
• Infrastructure CLI to talk to securely communicate with the above services via SSO authentication