# Nishant Goel > Principal Software Engineer at Microsoft | Data & AI | Azure | Microsoft Fabric Location: San Francisco Bay Area, United States Profile: https://flows.cv/nishantgoel I am a Principal Software Engineer at Microsoft, passionate about building highly scalable, resilient, and performant systems that power business-critical workloads. With a strong foundation in distributed systems, data engineering, and cloud-native development, I thrive at the intersection of large-scale system design and hands-on engineering. Throughout my career, I’ve architected and delivered solutions that handle petabyte-scale data for both streaming and batch processing, enhancing platform reliability and business agility. My work spans designing scalable APIs, optimizing Spark-based workflows, implementing telemetry and observability frameworks, and driving infrastructure modernization initiatives in the cloud. Before Microsoft, I had the privilege of contributing at Tesla and eBay, where I built scalable data platforms for machine learning and real-time analytics. Early in my career at CSC (Computer Sciences Corporation), I developed secure, scalable web services for the financial sector, gaining valuable experience in software development, enterprise system integration, and customer-centric solutions. I am deeply passionate about learning, system thinking, and innovation - constantly seeking opportunities to build solutions that are not only functional but also scalable, efficient, and elegant. I firmly believe in ownership, deep diving into technical problems, and raising the bar on engineering excellence. Core Areas: - Large-scale distributed systems - Big Data and Machine Learning infrastructure - Cloud platforms (Azure, AWS) - Scalable API design and microservices - Data engineering and real-time analytics - DevOps and Infrastructure as Code (Docker, Kubernetes, Airflow) Technical Skills: Languages: Scala, Java, Python, C++, JavaScript Frameworks: Spring Boot, Django, Flask Big Data: Apache Spark, Kafka, Hadoop, Hive, Airflow Databases: SQL Server, Oracle, MySQL, MongoDB, Elasticsearch, HBase Cloud & DevOps: Azure, AWS, Docker, Kubernetes Tools: Git, IntelliJ, Kibana, JIRA, Logstash Email: nishantgoel.softeng@gmail.com ## Work Experience ### Principal Software Engineer @ Microsoft Jan 2019 – Present Microsoft Fabric and Azure Synapse Analytics - Drive the architecture and platform strategy for Spark Environment Item, Library Management, and Custom Live Pools for Data Engineering workloads in Microsoft Fabric. - Drive the end-to-end Application Lifecycle Management (ALM) strategy for Environments, including Git integration, CI/CD automation, and Public APIs to support enterprise DevOps workflows. - Architect security and network isolation capabilities for Environment including multi-tenant isolation, Private Link integration, and outbound access protection to ensure secure enterprise connectivity and prevent data exfiltration. - Optimise Apache Spark runtime internals to improve startup latency, performance, reliability, and observability across Spark workloads. - Previously enhanced Apache Hive/LLAP internals in Azure HDInsight and modernized big data services by enabling Kubernetes-based containerized deployments. ### Senior Software Engineer @ Roku Inc. Jan 2019 – Jan 2019 | San Francisco Bay Area Data Management Platform (DMP) for OTT Advertising. ### Software Engineer II @ eBay Jan 2017 – Jan 2019 | San Francisco Bay Area ML Infrastructure for Advertising at eBay. ### Data Scientist @ Tesla Jan 2017 – Jan 2017 | San Francisco Bay Area Data Infrastructure - EV Superchargers ### Graduate Teaching Assistant @ San Jose State University Jan 2016 – Jan 2017 | San Jose, CA Worked as a teaching assistant for the following courses in Computer Science and Computer Engineering Department - Big Data Analytics (CS 286 | CS 185C) - Parallel Processing (CS 159) - Programming with NoSQL (CS 185C - 2) - Data Structures & Algorithms(CS 146) - Graduate Technical Writing (CMPE 294) ### Software Development Intern @ eBay Jan 2016 – Jan 2016 | San Francisco Bay Area • Designed and developed a Streaming Data Platform for eBay Commerce Network (ECN) to implement the data integration strategy for consuming petabytes of Ads, Traffic and Marketing data in real time • Worked with various teams to help architect the data model, ingestion, and aggregations to provide a powerful and seamless search capability across all kinds of data • Collaborated with data engineers, product managers and business people across several teams. • Increased efficiency and productivity within ECN by making required data available within a few seconds • Responsible for identifying, analyzing and resolving any issues on the platform architecture and defining optimizations for the overall stack Technology Stack: Apache Hadoop, Apache Kafka, Apache Spark, Elasticsearch, Java, Spring, Rest API, HBase, Oracle ### Product Developer @ Computer Sciences Corporation (CSC) Jan 2013 – Jan 2015 | Noida Area, India • Worked on US-based Banking Application product and was responsible for the design and development of web-based portal applications • Developed highly scalable web services for data retrieval from Mainframes using SOAP and REST APIs • Developed core banking modules which included Customer, Foundation, Deposits, Cards, and Loans • Responsible for identifying, analyzing and resolving production issues across multiple integrated applications • Automated multiple development processes like the creation of XML and HTML templates to increase the overall productivity by 30% • Designed an IFX Model using SoaML and UML concepts to represent web services. • Utilized strong communication skills in knowledge sharing sessions for new team members. Technology Stack: Java/J2EE, JavaScript, Dojo, JQuery, Service Oriented Architecture (SOA), XML, IBM WebSphere Portal Factory, IBM WebSphere Portal Server, HTML5, CSS3, Selenium and Mainframes ### Software Engineer Intern @ Air India Limited Jan 2012 – Jan 2012 • Worked on designing the user interface of various webpages like flight status, customer support and contact details. • Implemented a functionality of sending Emails to the users on reservation and cancellation of tickets using Java Mail API. • Gained technical acumen, strong interpersonal and teamwork skills while working in the real work environment. Technology Stack: JAVA/J2EE, Struts 2.0, HTML5, CSS3, Java Mail API, MySQL. ### Software Engineer Intern @ CMC LTD Jan 2011 – Jan 2011 • Developed a desktop application using J2SE concepts like SWINGS, to provide user with an environment to perform java source code editing and compilation. • Reduced time and effort of the user by automating the compilation and interpretation of Java code. ## Education ### Master of Science in Computer Science San José State University ### Bachelor of Technology (B.Tech.) in Computer Science and Engineering Guru Gobind Singh Indraprastha University ## Contact & Social - LinkedIn: https://linkedin.com/in/nishantgoel24 --- Source: https://flows.cv/nishantgoel JSON Resume: https://flows.cv/nishantgoel/resume.json Last updated: 2026-04-12