Microsoft Fabric and Azure Synapse Analytics
• Drive the architecture and platform strategy for Spark Environment Item, Library Management, and Custom Live Pools for Data Engineering workloads in Microsoft Fabric.
• Drive the end-to-end Application Lifecycle Management (ALM) strategy for Environments, including Git integration, CI/CD automation, and Public APIs to support enterprise DevOps workflows.
• Architect security and network isolation capabilities for Environment including multi-tenant isolation, Private Link integration, and outbound access protection to ensure secure enterprise connectivity and prevent data exfiltration.
• Optimise Apache Spark runtime internals to improve startup latency, performance, reliability, and observability across Spark workloads.
• Previously enhanced Apache Hive/LLAP internals in Azure HDInsight and modernized big data services by enabling Kubernetes-based containerized deployments.