# Rahul Malviya > Principal Software Development Engineer Location: San Mateo, California, United States Profile: https://flows.cv/rahulmalviya Working on building distributed frameworks using Big Data Technologies for Data Analytic / Machine Learning. Completed Master's in Computer Science from State University of New York at Buffalo in the field of Data Mining and Analytic, Distributed Computing, Databases and Data Intensive Computing. Specialties: • Programming Languages: Java, Scala, Python, Shell Scripting, Pig, JavaScript, SQL, C, C++ • Operating System: Mac OSX, Unix, Linux • Tools/Concepts: Maven, SBT, Gradle, Jenkins, Matlab, Oracle BI, Cognos 8.3 • Databases: Vertica, Neo4j, Mysql, Oracle, SQL Server, DRUID • Open Source Frameworks: Hadoop, HBase, Scala Playframework, Spark, Kafka, Parquet, Impala, Redis, Spring, Mongo Db, CDH, Akka, Google Webtool Kit, Google App Engine, Pig, Hive ## Work Experience ### Principal Software Development Engineer @ Workday Jan 2020 – Present Working on Workday's Prism Analytics product focused on interactive use-cases enabling customers to access data in interactive fashion using Spark as backbone. ### Senior Software Engineer @ Workday Jan 2019 – Present | San Francisco Bay Area Working on Workday Prism Analytics Product. ### Senior Software Engineer (Siri Data) @ Apple Jan 2019 – Jan 2019 | Cupertino, CA Worked on building distributed frameworks for Siri Data Org. • Kafka, Spark streaming, DRUID. • Developed a pipeline to enable spark internal metrics collection and aggregation using kafka, spark streaming and druid. ### Engineer @ Apple Jan 2011 – Jan 2019 | Cupertino Working on Big Data frameworks. ### Senior Software Engineer @ Apple Jan 2016 – Jan 2019 Worked on various Big data projects for SWE org. • Data ingestion pipeline using Kafka and Flume. • Worked on next iteration of data pipeline based on Parquet and impala. • Designed and implemented REST services for enabling communication between backend data processing and data collection. • Used graph database to solve query performance issue over nested json structure. • Worked on next iteration of backend data platform using new technologies like Parquet and Flume and evaluate its feasibility. ### Senior Software Engineer @ Apple Jan 2015 – Jan 2016 | Cupertino Built distributed frameworks using Big Data Technologies for iOS Wireless Team. • Designed and Developed Big Data solutions using open source technologies like Hadoop, HBase, Hive, Pig, Solr, Redis, MongoDB for IOS wireless diagnostics team. • Built custom parser for protobuf used during Map Reduce job achieving huge reduction in time. • Added search capability to framework by combining Map-Reduce on HBase, Akka IO, Sacla Play Framework. • Worked on service layer for UI using Scala Play framework. • Worked on multiple tools and utilities used by various internal team. • Designed and modified existing code in HBase / Hadoop framework to fix problems faced due to large scale of data. ### Senior Data Engineer @ Uber Jan 2016 – Jan 2016 | San Francisco Bay Area Built Data platforms for iSpend team. ### Engineer @ Buysight, Inc. Jan 2011 – Jan 2011 ### Summer Intern & Co-op @ Apple Inc. Jan 2010 – Jan 2010 • Designed and Developed in house Data Analysis tools using Java/J2EE, Perl, PL/SQL and shell scripting • Proposed, Designed and Developed Automation Job Processing API for data jobs using Java/J2EE and also Integrated API to a Web based Portal • Design a distributed architecture to process and run data intensive job parsing millions of logs lines • Designed, implemented and studied a generic distributed framework for running data intensive job over Hadoop Cluster using Pig Scripts and generic Map/Reduce code written in Java and Perl • Working on performance tuning for jobs running at Hadoop cluster using the customized values for the default parameters. •Designed and developed monitoring application for SQL process to track the progress using Java/J2EE and Google Web Toolkit. ### Graduate Assistant @ University at Buffalo Jan 2009 – Jan 2010 • Contributed to project at The School of Marketing under Dr. Arun K. Jain to study the effect of Marketing strategies over consumer buying pattern using techniques of Data Mining • Designed and Developed Data Model to store the raw Customer and Wine data using SQL and PL/SQL • Proposed, Developed and studied various Clustering Algorithms using Matlab and Java ### Associate Application Developer @ Computer Sciences Corporation Jan 2007 – Jan 2009 Client: RailCorp • Developed Web based Java/J2EE Application named “TDM2” application for Time Table Management and Distribution of Railways for Australian Metro Rail • Developed User Interface Screens for TDM2 using JSP, HTML, CSS and Struts using the tag libraries • Implemented the Middle and Controller layer using the EJB, Spring and Hibernate • Developed reports for Business users using Cognos having Oracle 10g backend database system and integrated them to a common platform built on Java • Researched performance improvement techniques for query hits on Oracle 10g database to speed up report response time Client: Quatrro • Developed a product named “Concierge” used in financial institutions for Risk Management using Business Intelligence Tool Oracle BI • Developed Business reports using Oracle BI and improved query performance of the existing reports using SQL queries over SQL Server 2005 • Proficiently used JavaScript and CSS to customize Oracle BI standard User Interface according to client requirements • Individually architected a Java and C++ based program to parse XML files generated for reports • Utilizing SQL Server as database, designed data models and database schemas using concepts of Dimensional Modeling and Data Warehousing and also worked on optimizing query performance ### Associate Projects @ Covansys Jan 2007 – Jan 2009 ## Education ### Master's in Computer Science Buffalo State University ### Bachelor of Technology in Computer Science and Engineering National Institute of Technology Durgapur ### St. Gabriels ## Contact & Social - LinkedIn: https://linkedin.com/in/malviyarahul - Portfolio: http://sites.google.com/site/rahulsworkspace --- Source: https://flows.cv/rahulmalviya JSON Resume: https://flows.cv/rahulmalviya/resume.json Last updated: 2026-04-12