# Sanil Jain > Data Infrastructure @ Linkedin Location: San Francisco Bay Area, United States Profile: https://flows.cv/saniljain Sanil is a staff software engineer at LinkedIn, where he works on the infrastructure (data/ml infra) team. He has driven realtime ML infrastructure initiatives at LinkedIn. He is also a committer of Apache Samza, an open-source framework for distributed stream processing. He has more than ten years of experience in software development, working across the stack and with various technologies, such as open source data processing framework Before Linkedin, Sanil has an experience of working with Big Data Infrastructure (Hadoop/Hive/Spark) at Trip Advisor, Facebook Sanil is passionate about building and solving problems at scale, and he has contributed to several projects and initiatives that enhance the performance, reliability, and scalability of LinkedIn's streaming & batch processing infrastructure recently. He has strong interpersonal, analytical, and management skills, and he enjoys collaborating with other engineers and stakeholders. In his spare time, he likes to play tennis and soccer, and debate on global issues. ## Work Experience ### Staff Software Engineer @ LinkedIn Jan 2022 – Present | San Francisco Bay Area • Convergence at Linkedin aimed at solving streaming & batch compute & data convergence using Apache Flink & Apache Iceberg at Linkedin on Kubernetes • Managed Stream Processing Platform with Apache Beam & Flink • Led Real time Machine learning initiatives at LinkedIn, including Realtime Feature Generation Platform, Feature Access (Remote + In process local) and low latency Model Inference. • Managed key stakeholders for Streaming Infrastructure, such as Notifications Platform and ML infra. ### Senior Software Engineer @ LinkedIn Jan 2020 – Jan 2022 | San Francisco Bay Area • Stream Processing Platform at Linkedin - 4T msgs a day • Apache Beam at Linkedin ### Software Engineer @ LinkedIn Jan 2018 – Jan 2020 | San Francisco Bay Area • Developed fundamental layer for managing Apache Yarn cluster for Streaming infra LinkedIn, enabling graceful container movement and restart for stateless & stateful jobs. • Contributed multiple oss improvements to Apache Samza ### ASF Committer @ The Apache Software Foundation Jan 2021 – Present | San Francisco Bay Area Committer - Apache Samza Contributor - Apache Beam ### Software Engineering Intern @ Facebook Jan 2017 – Jan 2017 | Menlo Park, CA Worked as a full stack intern with Ads Growth and Incentives team. Built tool around coupons and worked around simplifying coupon infra using Hack, XHP and other internal tools and APIs • Built a web app for centralized coupon budget tracking, multi-currency diagnostics and informing payment decisions • Improved issue debugging and consolidated coupon infra management by developing a tool using Hack and XHP • Redesigned and simplified Coupon Infra and integrated various live products on web and mobile with coupons ### Software Engineer @ TripAdvisor Jan 2017 – Jan 2017 | Needham Using agile technologies worked as a big data and operations intern with technologies like HDFS, HIVE, Shell scripts, Python, Kubernetes, Docker etc. • Designed and developed a big data pipeline for CDN data analysis to aid cost cutting by data comparison • Architected pipeline and wrote Shell & Python Scripts to perform parallel extraction, transformation, and loading of terabytes of daily data into HDFS • Wrote Hive queries to parallel process the data for extracting information and hourly metrics • Wrote modules to transform the data into time-series and relational databases for data analytics and information extraction • Deployed the whole pipeline in Kubernetes using Docker configs and also equipped the system with an error detection and anomaly reporting system • Created an error parsing dashboard to see the server error status, designed a web application to list, search, parsed server status logs ### Software Developer Intern @ CDK Global Jan 2016 – Jan 2016 | Portland, Oregon Area As a part of DMS Core Platform Core team using Agile/Scrum methodologies in Linux and Windows based platforms. Worked with technologies: ELK Stack (Elasticsearch Logstash Kibana), Shell Scripts, AngularJS, NodeJS, Jasmine JS, Angular Material, Bootstrap, Vagrant, Bamboo • Developed Elasticsearch Mapping Parser to automate the process of template generation for Elasticsearch • For each document type system parses apply checks to gives in-depth analysis of errors (if any) with an efficient error detection and correction mechanism. • Developed System Secure Status Dashboard & User Exception Dashboard Web applications • Wrote shell scripts to parse system generated data to feed system attributes to Elasticsearch. • Developed two data visualization tools which provide several charts with drill-downs for comprehensive analysis of system attributes • Wrote queries to aggregate, fetch and categorize JSON data using Elasticsearch APIs( Search, Document, Aggregations) on security attributes & other user attributes • Developed two responsive web application with using Elasticsearch APIs AngularJS, Chart Js, Bootstrap, NodeJS, Express • Participated in World Hackathon and worked on a Sentiment Analysis App • Took a hands-on session for High School Students on AngularJS • Participated in Food Bank Volunteer Service. ### Information Technology Services - Student Staff @ Northeastern University Jan 2015 – Jan 2016 | Boston Job responsibilities include: • Managing IT equipment such as plotters, computers, laptops, printers etc. across the campus • Provided walk-in, remote desktop and phone based technical assistance for students, faculty, staff and parents. • Troubleshot and resolve various software and hardware issues across university's computing infrastructure. • Administer Library's loaning system for various IT equipment's i.e manage the loaning, maintaining and returning of various devices. ### Director External Affairs @ Model United Nations Jan 2014 – Jan 2014 | Greater Indore Area • Played a key role in organizing the biggest and the very first Model United Nations for the city under Indore Model United Nations (Indore MUN) - 2015 • Negotiated several corporate deals on behalf of Indore MUN • Headed the team of external affairs which was responsible for promotions of the event across the city in various schools and colleges. ### Java Developer Intern @ ProDev Solutions Jan 2013 – Jan 2014 | Indore • Extensive working in Software Development Life Cycle (SDLC) like System Analysis, Design, Development, coding, testing and using technologies like Java SE, Java EE, Spring, Hibernate. • Worked as a part of various teams to develop several components of web based applications using several web tools like Bootstrap, HTML5, CSS3, JQuery, JavaScript and mentioned Java technologies. • Implemented and enhanced my understanding of industrial design patterns & object oriented concepts like Model View Controller (MVC), Data Access Object (DAO), Dependency Injection (DI), Inversion of Control (IOC), Spring MVC, and Bean Factory. • Worked on a production module of an ERP application using Spring and Hibernate. • Created software specification reports with UML modelling using Class diagrams, Activity diagrams, Use cases and Entity Relationship diagrams. ## Education ### Master of Science - MS in Computer Science Northeastern University ## Contact & Social - LinkedIn: https://linkedin.com/in/sanil15 - GitHub: https://github.com/Sanil15 --- Source: https://flows.cv/saniljain JSON Resume: https://flows.cv/saniljain/resume.json Last updated: 2026-04-12