# Anuj Gandhi > Senior Software Engineer, Big Data at Zillow Location: San Jose, California, United States Profile: https://flows.cv/anuj With over 6 years of experience, I'm a Big Data Software Engineer adept at transforming complex data into actionable insights. Skilled in Hadoop, Spark, Airflow, and more, I excel in designing scalable solutions that drive business growth. Let's connect to explore how I can contribute to your team's success. ## Work Experience ### Senior Software Engineer Big Data @ Zillow Jan 2022 – Present | San Jose, California, United States • Built a robust data pipeline to create a high quality dataset, facilitating seamless integration between two business lines at Zillow. Enabled data science partners to drive an estimated $30 million revenue enhancement. • Developed a Python cookiecutter for self-serving Airflow DAG generation. Increased developers efficiency and facilitated the construction of over 20 DAGs for the team. • Collaborated with principal architects to architect an enterprise dimension model, establishing best practices for its implementation. • Built comprehensive dimension models to seamlessly onboard critical L1 metrics through a semantic layer ### Software Engineer II Big Data @ Zillow Jan 2021 – Jan 2022 | United States • Created a self-service tool facilitating seamless onboarding of raw JSON data into Parquet-based Hive tables. Widely adopted by numerous customers for efficient data lake integration • Developed a scalable, standardized Scala-based pipeline structure for the team, segregating business logic from input/output. Reduced dev time, enhanced MR review, and eased unit test integration • Built high quality data pipelines to create business critical data products by working with data science partners and cross functional teams ### Senior Big Data Engineer @ Emailage Jan 2019 – Jan 2021 | Greater Phoenix Area • Designed, built and maintained scalable, serverless, near real-time data warehouse; Ingested ~5M transactions daily; Reduced analytical query execution time by 10x • Collaborated with security and compliance team to make the data secure and GDPR compliant • Implemented lambda architecture for real-time dashboard to monitor ML model and model features • Created Spark applications which reduced time of daily SQL queries from 3 hours to under an hour • Deployed neo4j and implemented Pregel Algorithm to leverage Graph analysis for fraud prevention ### Big Data Developer @ Emailage Jan 2018 – Jan 2019 | Phoenix, Arizona Area • Dockerized Shiny app dashboard and deployed on K8s cluster to enable CI/CD pipeline • Implemented interactive web app to generate high/low-risk rules to streamline Decision Scientists workload • Built an ETL pipeline to load the data in PostgreSQL data warehouse for data analysis ### Research Assistant @ Arizona State University Jan 2016 – Jan 2019 | Tempe, Arizona UN Project: • Scraped dark web, social media data anonymously and maintained ETL pipeline for its sentimental analysis • Migrated Apache Solr to Elasticsearch – Designed distributed multi-node cluster to improve reliability, availability, and performance; indexed over half billion data records in Elasticsearch for fast retrieval • Developed and deployed six rich interactive visualization dashboards to find actionable insights • Integrated React.js into all the dashboard websites to ensure high quality and reusability of code • Maintained ETL pipeline on the stream of Tweets Lockheed Martin Project: • Worked on analytical NLP project for real-time discovery of issues, their frames, and evolutionary topic tracking • Wrote batch script to automate project pipeline; incorporated hashing to reduce time complexity of string matching • Created visualization website to explore the content of large set of news articles to leverage quick reading ### Team Lead @ Rolocule Jan 2015 – Jan 2016 | Pune Area, India • Led development of “Mahayudh”; a mobile fighting game from conception to prototype stage • Worked closely with project manager, developers, artists to produce accurate delivery estimates • Improved code reliability and performance by integrating IoC/Binding MVC framework • Designed game architecture • Implemented initial prototype, foundational modules, gameplay ### Software Developer @ Rolocule Jan 2013 – Jan 2015 | Pune Area, India • Worked closely with design team to build and maintain complete UI of ‘Dead Among Us’; a mobile FPS game • Profiled CPU, GPU and memory usage and improved game performance by 25% • Received outstanding performer for two consecutive years at Rolocule Games ## Education ### Master of Science (MSc) in Computer Science Arizona State University Jan 2016 – Jan 2018 ### Bachelor of Engineering (BE) in Computer Engineering Pune Institute of Computer Technology Jan 2009 – Jan 2013 ## Contact & Social - LinkedIn: https://linkedin.com/in/anuj-g - Website: https://anuj-g.github.io/ --- Source: https://flows.cv/anuj JSON Resume: https://flows.cv/anuj/resume.json Last updated: 2026-03-22