Served as a key engineer for the SDL Data Pipeline and STAR Colossus Project, building the foundational systems for large-scale data processing and ingestion.

• Architected the Central Nervous System for Enterprise Data: Built and scaled the sdl-data-pipeline from the ground up, processing terabytes of batch and streaming data with Spark on GCP Dataproc. This pipeline became the single source of truth, directly fueling business intelligence and enabling future ML models.

• Mastered High-Stakes Data Operations: Owned the operational health of dozens of concurrent Spark/Hadoop jobs across multiple Dataproc clusters. Expertly diagnosed and resolved complex job failures in real-time, ensuring high data availability for mission-critical services.

• Engineered Bulletproof Ingestion Services: Developed the core Java/Spring Boot microservice for all incoming telemetry data, creating a secure, high-throughput gateway. Implemented a robust JWT-based security model that guaranteed data provenance—a non-negotiable for building trusted AI.

• Automated the Entire Data Lifecycle: Eradicated manual toil by scripting the end-to-end data workflow. Wrote powerful Bash and Python automation to handle everything from PostgreSQL extraction and GCS migration to archival, creating a self-healing and zero-maintenance data ecosystem.

Technical member of the CASB (Cloud Application Security Broker) team.

• Member of Architecture Change Team: implemented user authentication and authorizing features to secure Symantec's schema registry.

• Designed, developed, optimized and hardened data processing framework and applications to enable real-time and batch ingestion of Peta-Bytes of cyber security related telemetry data into data lake. This successful effort has resulted in significant amount of cost savings for the company.

• Technologies:

Java, Spring, Spark, Kafka, Zookeeper, Storm, Hive, Oozie, HBase, Avro, ORC, Hadoop, MapReduce, AWS, S3, RDS/MySQL, Apache Ignite, Json Web Token, LDAP

Built Symantec's Big Data Cyber Security Analytics platform on Amazon's AWS.

• As a core member of the Symantec Authoritative Data Lake team, designed and developed real time streaming application using Apache Storm, Kafka, HDFS and HBase.

• Enable fast lookup service (for data enrichment and data correlation) using open source solutions such as Chronicle Maps and Redis.

• Developed data quality tool to collect Hive database and table meta data, to detect missing partitions.

• Developed tools to monitor data ingestion rate, and alerting system for ingestion lags.

Developer for Narus network traffic intelligence, network analytics and cyber

security products suites.

Implemented job scheduling feature using open source solution Quartz.

Developed REST service using GlassFish/Jersey.