Leading Core Seller Payments Platform that handles US and international payouts, fintech products, risk management.

Worked with clients - Paypal, Walmart Labs, Bidtellect, ATNi, Cardlytics, Boingo Wireless, Verizon Telematics

Responsible for leading and delivering end-to-end solutions to clients using BigData platform in various industries like Education, Native Ads, and Communication. In addition to software architectural duties, educate developers on design principles and ensure code quality

• Design the architecture for the Hadoop solutions using Cloudera Distribution.

• Manage data lake on AWS cloud platform

• Design Data pipeline using Sqoop, Spark and Hive and Impala

• Orchestrate the workflow using Airflow jobs

• Work with a variety of data formats like CSV, Avro, Parquet, ASN (communications)

• Gather requirements related to the Data Pipeline, Data Storage and Maintenance and Data Visualization

• Implement Data Visualization solution using tools like ZoomData, Tablaeu, Trifacta, Banana

• Design search platform solutions using Cloudera Search - Solr

• Integrate the application with the Kerberos security features

• Provided code and architectural reviews

Client - Verizon Wireless

1. A Senior Developer in Big Data/Hadoop Platform with 9 years of experience in Java/J2EE technology including 2.5 years in Hadoop as part of large-scale projects.

2. Successfully leading the projects involving end to end solution using Big-Data involving Data Ingestion, Streaming, Storage, Analysis, Indexing and Reporting to Dashboard for Customer Calls Data, Chat Conversations, Social Data (Twitter).

3. Strong experience in designing Batch processing systems using Map Reduce, HBase Bulk Loading Data Ingestion, Customized Hbase row counters with Filters, Hbase Integration(Source and Sink), Classic MapReduce v/s YARN architecture, Record Reader usage and Joins.

4. Designed Real-time processing systems using Kafka, Storm Topology, VOCI(Automated Speech

Transcription system) integration with Kafka, Spout integration with Kafka, Bolt integration with HDFS and HBase, Live Streaming for Twitter GNIP

5. Good understanding of HBase Architecture, Schema and Row key design for scalability and performance, HBase NG Data Indexer (mapping to Solr), Rest API client access

6. Designed data models for presentation access layer using NoSQL columnar database HBase

7. Very Good working knowledge of Solr – a search platform, Lucid Works Fusion(framework on top of Solr) Integration, Pipeline Architecture, Indexer processing stages, Analyzer-Token-Filter life cycle, Faceted search, highlighting, Stats Analysis, Nested Documents Design, Entity Extraction for categorization.

8. Worked with Hive using Hive QL, Optimal Partitioning and Bucketing, Data migration with Hive-Hbase integration (Storage Handlers), Experience in writing User Defined Functions (UDF’s), Worked on Optimizing Hive queries using Tez and ORD File formats.