• Contributed to Data Ingestion Pipeline application that receives and processes 2 billion events (web traffic logs) per day. Added features that enhanced raw log data with new attributes which enabled the downstream data classification jobs

• Developed high performance Spark EMR applications to power Data as a Service (DaaS) products including Curated Data Feeds and Audience Segments. Built Airflow DAG applications to seamlessly schedule automated data delivery to customers.

• Collaborated with data scientists to integrate machine learning(ML) models into the backend

• Developed and deployed Privacera Discovery SaaS Solution which provides data privacy and governance solutions for data residing in cloud storages, databases and data warehouses. Leveraged Apache Spark distributed computing engine to classify huge volumes of data and utilized Cassandra to provide persistence with high availability.

• Built the Privacera Encryption Gateway(PEG) service that provides encryption/masking functionalities to protect sensitive enterprise data. Led the deployment of the PEG to cloud Docker/ Kubernetes environments

• Led the development and deployment of Privacera Vault Service to securely store various internal application credentials. Integrated with Hashicorp Vault and Apache Ranger in the backend for the storage and access control of the credentials

• Developed scalable, distributed backend application (Read Orchestrator/RO service) to serve millions of requests per minute from walmart.com site traffic. Integrated with Kafka to facilitate high throughput messaging interaction between several systems including pricing system, inventory system. Leveraged Cassandra for persistent storage with fast read and write operations.

• Contributed to the architecture and enablement of Next Day Delivery Service which is currently live in thousands of locations in the US . Carried out operational and monitoring tasks using OpenStack cloud infrastructure platform, Kibana, Splunk and other tools.

• Developed applications and services for ordering products, enabling services and managing customer information such as credit card data. Contributed heavily to developing a RESTful services and integrated Ooma solutions with third party (Zscaler) cloud security service and Arlo home monitoring solutions.

• Rearchitected existing systems and brought Ooma services internationally to France, Australia and Great Britain. Built a data pipeline between the various microservices using Kafka and Zookeeper

• Contributed to the development of infrastructure and web applications for the ingestion of digital assets like e-books, magazines and subscriptions. Built caching framework using Memcached for faster access of data on the site and reduced latency by 500ms. Incorporated MongoDB to the infrastructure for faster response to search requests coming form the website.

• Developed video metadata ingestion platform and integrated with an external vendor(Deluxe Content Manager). This enabled on-boarding of new video titles to our catalog and in-turn increased customer engagement by 50% over the next two quarters.