# Parth Upadhyay > Engineering at Watershed Location: New York, New York, United States Profile: https://flows.cv/parthupadhyay Software Developer, experienced in building and maintaining reliable and scalable systems with a diverse set of experience both in the US and overseas. ## Work Experience ### Software Engineer @ Watershed Jan 2024 – Present | New York, New York, United States ### Senior Software Engineer - Data Platform @ Samsara Jan 2021 – Jan 2024 Built infrastructure and tooling powering our entire offline analytics platform, enabling product and data science teams to analyze petabytes of sensor data from millions of devices. Primarily worked with Spark / Databricks, AWS services (Database Migration Service, Aurora, Glue, Step Functions, DynamoDb), Dagster, Terraform. ETL and Data Validation - Overhauled and lead efforts to build end to end validation tooling for replication processes for proprietary timeseries data, improving company confidence in replicated data. - Redesigned the replication path for Aurora RDS databases, cutting costs in half as well as improving maintainability and correctness. As part of this, became an active member of the internal database working group, helping on critical efforts like company-wide aurora 1->2 upgrade. Contributed upstream to Spark Protobuf to improve Protobuf parsing from Spark 3.4.0+. Data Pipelines + Precomputed Reports - Maintained our in house Data Pipelines framework built on top of AWS Step Functions and Spark, to allow showing terabyte-scale reports to customers. Cost Savings - Led multiple efforts to save the company upwards of $3 million a year by: - Using spot instances, and diversifying across machine type and AZ to reduce spot interruptions. - Query optimization as well as platform optimization (delta vacuum jobs, table optimizations, etc.) to reduce waste and total costs. - S3 lifecycle and tiering improvements to reduce the costs of petabytes of storage. - Improving databricks compute utilization. Also, improved monitoring of costs to prevent future regressions. Table Access Controls & Compliance - Leading efforts to implement granular table access controls to improve privacy/least privilege posture and increase auditability for a growing internal userbase. - Includes leading an effort to federate access controls to data-owners, and improve controls on both product and internal enterprise data ### Senior Software Engineer - Team Lead @ Samsara Jan 2020 – Jan 2021 | San Francisco, California, United States Lead a full stack product team and executed on cross-functional full stack work across various verticals on the Samsara platform. Especially key were issues of scale, with millions of data points consumed every day, and product flexibility, as our enterprise customer base had a broad set of needs across almost every industry. Technologies used include kinesis, mysql, go, graphql, typescript, react, spark. Gateway Health Helped lead a cross functional effort over months to build and deploy a new report that gave both customers insight into the health of their fleets, and our internal teams the tools necessary to debug those issues. - used hardware data ingested from hundreds of thousands of devices and indexed results for efficient access - built offline computation logic in Spark providing a platform for broad analytical capabilities into health information - complex, multi-stage rollout with stakeholders both in and out of the organization Reporting and Data Analytics Built, optimized, and maintained full stack reports using a variety of internal reporting systems, notably a Spark cluster enabling us to query near-petabyte-scale data. - vehicle activity and usage to help clients identify low usage vehicles - time spent at certain sites - colocation reporting for field service teams - an analysis of inconsistencies in ingested odometer data to help inform firmware diagnostics efforts Data Management Collaborations Full stack representative for a cross functional group that was formed to help deploy a system to catalog and describe data in our data warehouse for easier consumption by internal teams. ### Senior Software Engineer @ Samsara Jan 2019 – Jan 2020 | San Francisco, California, United States ### Software Engineer @ LINE Corp Jan 2017 – Jan 2019 | Fukuoka, Japan Built backend and full-stack services supporting LINE stickers and LINE Wallet, used by over a hundred million users around the world. - Line Custom Stickers Built the core sticker rendering in a product that allowed users to include custom text into sticker sets created by designers. Modeled the sticker text as SVGs, and built an SVG rendering pipeline using Java Graphics, integrating with a CDN, Redis Cache, Mongodb, and Spring Boot application. Was responsible for the entire stack including server allocation, load balancing and scaling, release monitoring, etc. Additionally, built a partner-facing CMS to allow creation and modification of these sticker sets using Kotlin, Spring Boot, Mongodb, and Custom Elements. - Line Wallet Helped build, monitor, and maintain the Line Wallet tab, which interfaced with a suite of financial products built by LINE. Maintained and improved Redis caching for data from downstream services, as well as a messaging API with rate-limiting to consolidate all financial messages from LINE through a single channel. Sped up internal testing by rebuilding the internal CMS using Kotlin, Vue.js and Typescript. - SRE Overhauled and consolidated multiple application alerting pipelines into a single pipeline using Prometheus. In addition, re-built our batch job monitoring and analytics. ### Assistant High School English Teacher @ Japan Exchange and Teaching Program(me) (JET) Jan 2016 – Jan 2017 | Sanda, Japan Worked as an assistant teacher at a high school in Japan, with the goal of fostering interest and excitement toward foreign language learning, as well as promoting cultural exchange. In-school duties included developing curriculum, running an after school English club and teaching classes full-time. Outside of school duties focusing on cultural exchange included English conversation clubs, judging local speech competitions, and participating in local cultural fairs. ### Software Engineer @ Coursera Jan 2014 – Jan 2016 | San Francisco Worked on building reliable backends to support various parts of the Coursera product. - Instructor Dashboards and Analytics Provided insights to instructors about how users were engaging with their courses through Analytics Dashboards showing information such as course retention rates, assignment continuation rates, assessment statistics and other general statistics. Helped build and manage data ETL into Amazon Redshift, querying logic, as well as APIs to access generated reports. - Forums Architecture Helped lead an architecture overhaul of the Forums product in response to product needs for greater flexibility (namely, for use outside of the original Courses product). Included redesigning the data model and API structure, search logic, offline Kafka processing, and the migration from the old data model to the new data model. Worked using Scala, Play, Solr, Cassandra, and Kafka. - Course Authoring Helped build a suite of tools to allow instructors to modify and publish new versions of their courses via the product, which previously was largely handled by an operation steam. Included API and data model design, as well as tight integration with both engineering and operational teams. - Facilitated Learning Helped build and test out a prototype for mentor-based learning, where users could enroll in a special course session and have access to a dedicated mentor for their courses. ### Teaching Assistant - Honors Operating Systems @ The University of Texas at Austin Jan 2013 – Jan 2013 | Austin, TX Serving as a teaching assistant for an honors operating systems course. Duties include teaching recitation section, holding office hours, developing lab materials, grading papers, and assisting students in all matters pertaining to the class. ### Software Development Intern @ Square Jan 2013 – Jan 2013 | San Francisco, CA Worked on a full-stack team developing features for Square Invoicing in Ruby on Rails. In addition, helped implement a tool to reduce build times by improving dependency management for protocol buffers in the project. ### Teaching Assistant - Operating Systems @ The University of Texas at Austin Jan 2013 – Jan 2013 Served as a teaching assistant for an operating systems course. Duties included leading weekly recitation sections, holding office hours, developing lab materials, grading papers, and assisting students in engaging and learning the course material. ### Software Development Intern @ Facebook Jan 2012 – Jan 2012 | Seattle, WA Developed tools for assessing chat reliability, and tools to help developers respond to failures in chat more quickly. ### Undergraduate Teaching Assistant - Research Methods @ University of Texas at Austin Jan 2011 – Jan 2011 Served as a mentor for a group of honors science students in a seminar class focused on familiarizing students with independent inquiry and research methods. Assisted students in proposing ideas for, planning, and completing several individual inquiry projects as well as a final cohort project. ### Financial Software Development Intern @ Bloomberg Jan 2011 – Jan 2011 | New York, NY Built infrastructure in python to support data retrieval from new exchanges by periodically scraping a JSON API. Developed an internal tool to aid in log-diffing to improve quality control in the development process. ### Information Technology Intern @ Healix Jan 2010 – Jan 2010 Solved day to day computing issues within the company, and began the automation of various program installations. ## Education ### B.S in Computer Science The University of Texas at Austin Jan 2010 – Jan 2014 ## Contact & Social - LinkedIn: https://linkedin.com/in/paupadhyay --- Source: https://flows.cv/parthupadhyay JSON Resume: https://flows.cv/parthupadhyay/resume.json Last updated: 2026-03-23