# Ram Pedapatnam > Engineering Lead | Architect | Speaker | AI/ML/Data/SWE Location: San Jose, California, United States Profile: https://flows.cv/rampedapatnam -- Technology Lead with over 18 years of experience in building large-scale distributed applications with high-availability -- Successfully led a Customer Insights Solution that reduced 70% of the operating cost to the client using Cloudera Distribution(CDH) and Zoomdata. -- Delivered “Zero-Data-Loss” events platforms primarily handling Transactional Data in Financial Data Domain platforms for a leading online payments platform client, that caters 2 Billion Events per day -- Successfully delivered Payments Platform Framework for a leading multi-tenant E-Commerce that handles large scale transactional data, vendor payments across different countries. Also manages fintech products, risk management, ledgering, international payments, onboarding. -- Uber Tech Lead who is helping more than 20 people in mentoring and delivering software -Worked on extracting Sentiment Analysis of the social media tweets for a leading telecommunications client using “Live Streaming for Twitter GNIP”, Storm Topology, Spout integration with Kafka, Bolt integration with HDFS and HBase -- Build Real-time processing systems using large-scale distributed messaging system like Kafka, fault-tolerant stream processing framework like Spark Streaming -Strong experience in designing Batch processing systems using Spark, Map Reduce, Impala, Hive, HBase Bulk Loading Data Ingestion, Customized Hbase row counters with Filters, Hbase Integration(Source and Sink), Cassandra, Classic MapReduce v/s YARN architecture, Record Reader usage and Joins. -- Good understanding of HBase/Cassandra Architecture, Schema Design and Row key design for scalability and performance, HBase NG Data Indexer (mapping to Solr), Rest API client access Designed data models for presentation access layer using NoSQL columnar database like HBase, Cassandra for accessing Transactional Data with low latency -- Very Good working knowledge of Solr – a search platform, LucidWorks Fusion(framework on top of Solr) Integration, Pipeline Architecture, Indexer processing stages, Analyzer-Token-Filter life cycle, Faceted search, highlighting, Stats Analysis, Nested Documents Design, Entity Extraction for categorization, Sentiment Analysis ## Work Experience ### Staff Software Engineer @ Walmart Global Tech Jan 2022 – Present | Sunnyvale, CA Leading Core Seller Payments Platform that handles US and international payouts, fintech products, risk management. ### Senior Software Engineer @ Walmart Global Tech Jan 2021 – Jan 2022 | Sunnyvale, California, United States ### Lead Software Engineer (Data) @ Clairvoyant LLC Jan 2015 – Jan 2021 | Chandler, Arizona Worked with clients - Paypal, Walmart Labs, Bidtellect, ATNi, Cardlytics, Boingo Wireless, Verizon Telematics Responsible for leading and delivering end-to-end solutions to clients using BigData platform in various industries like Education, Native Ads, and Communication. In addition to software architectural duties, educate developers on design principles and ensure code quality • Design the architecture for the Hadoop solutions using Cloudera Distribution. • Manage data lake on AWS cloud platform • Design Data pipeline using Sqoop, Spark and Hive and Impala • Orchestrate the workflow using Airflow jobs • Work with a variety of data formats like CSV, Avro, Parquet, ASN (communications) • Gather requirements related to the Data Pipeline, Data Storage and Maintenance and Data Visualization • Implement Data Visualization solution using tools like ZoomData, Tablaeu, Trifacta, Banana • Design search platform solutions using Cloudera Search - Solr • Integrate the application with the Kerberos security features • Provided code and architectural reviews ### Senior Engineer - Big Data/Haoop @ Collabera Inc. Jan 2015 – Jan 2015 | Dallas/Fort Worth Area Client - Verizon Wireless 1. A Senior Developer in Big Data/Hadoop Platform with 9 years of experience in Java/J2EE technology including 2.5 years in Hadoop as part of large-scale projects. 2. Successfully leading the projects involving end to end solution using Big-Data involving Data Ingestion, Streaming, Storage, Analysis, Indexing and Reporting to Dashboard for Customer Calls Data, Chat Conversations, Social Data (Twitter). 3. Strong experience in designing Batch processing systems using Map Reduce, HBase Bulk Loading Data Ingestion, Customized Hbase row counters with Filters, Hbase Integration(Source and Sink), Classic MapReduce v/s YARN architecture, Record Reader usage and Joins. 4. Designed Real-time processing systems using Kafka, Storm Topology, VOCI(Automated Speech Transcription system) integration with Kafka, Spout integration with Kafka, Bolt integration with HDFS and HBase, Live Streaming for Twitter GNIP 5. Good understanding of HBase Architecture, Schema and Row key design for scalability and performance, HBase NG Data Indexer (mapping to Solr), Rest API client access 6. Designed data models for presentation access layer using NoSQL columnar database HBase 7. Very Good working knowledge of Solr – a search platform, Lucid Works Fusion(framework on top of Solr) Integration, Pipeline Architecture, Indexer processing stages, Analyzer-Token-Filter life cycle, Faceted search, highlighting, Stats Analysis, Nested Documents Design, Entity Extraction for categorization. 8. Worked with Hive using Hive QL, Optimal Partitioning and Bucketing, Data migration with Hive-Hbase integration (Storage Handlers), Experience in writing User Defined Functions (UDF’s), Worked on Optimizing Hive queries using Tez and ORD File formats. ### Software Development Consultant @ Deloitte U.S. India offices Jan 2013 – Jan 2015 | Hyderabad Area, India ### Lead Software Engineer @ United Online Jan 2011 – Jan 2013 ### Software Engineer 1 @ PAREXEL Jan 2009 – Jan 2011 ### Software Developer @ Mahindra Satyam Jan 2006 – Jan 2009 ## Education ### Master’s Degree in Industrial and Organizational Psychology Annamalai University ### Bachelor's degree in Electrical, Electronics and Communications Engineering Andhra University ## Contact & Social - LinkedIn: https://linkedin.com/in/ramzprasadz - Portfolio: http://site.clairvoyantsoft.com/understanding-resource-allocation-configurations-spark-application/ --- Source: https://flows.cv/rampedapatnam JSON Resume: https://flows.cv/rampedapatnam/resume.json Last updated: 2026-04-12