• Responsible for building Cisco's First ever Big Data Analytics platform that serves Data as a Service (DaaS)
• Designed, implemented and deployed back end engine using Spark that does cleansing and enrichment of millions of network events which is persisted in HBase, Elasticsearch to offer it to different systems, applications, end users
• Built custom Two-Factor Authentication(2FA) module to ensure customer data security for both user and system requests
• Responsible for Elasticsearch cluster design, infrastructure ask and computation based on incoming data, customer requests, history data, trends and purge policies
• Implemented Restful Web services using Spring, Apache CXF by writing complex real time ElasticSearch, SparkSql queries to return response and API Management using MuleSoft, Layer 7
• Built and deployed Big Data distributed application on 100+ VMs running in production there by achieving 300X Performance improvement compared to Traditional SQL Based System
• Built end-end entitlement component that provides client, user, account, role mapping and privilege to access business data
• Implemented master data distributed caching and in-built scheduler to refresh data based on scheduled time, on-demand that accelerates the application
• Resolved Performance issues & limitation on Elasticsearch by custom component implementation on server side
• Researched and used several third-party and open source tools for product development
Relevant keywords: Hadoop, HDFS, HBase, Spark, Java, Scala, Distributed Cache, Two-Factor Authentication (2FA), Restful Web service, Spring, Apache CXF, JAXB, HBase, Spark, Elasticsearch, MapR, Performance Tuning