• Led the design and development of auto-scale infrastructure for Azure HDInsight

• Optimized cloud resource utilization, improving performance and reducing operational costs across large-scale clusters.

• Implemented security enhancements and zero-touch certificate automation, streamlining processes and increasing efficiency.

• Contributed to open-source projects like Apache YARN and HBase, driving innovations in big data technologies.

Azure HDInsight Engineering

• Designed and developed reliable, transactional messaging platform (libraries and messaging patterns) using Apache Kafka

• Designed and developed backend APIs for order monitoring and message reconciliation system based on master-slave architecture for multiple Kafka clusters

• Developed scalable REST APIs and message ingestion layer for order search system using Elasticsearch

• Tech: Java, Spring, Apache Kafka, Elasticsearch