Mumbai, Maharashtra, India
Cloud Migration (AWS): Executed the on-premise to AWS cloud migration for the Personalization tech stack. Successfully migrated Terabytes of user data with zero data loss, ensuring high availability for downstream applications.
Real-Time Data Engineering: Engineered high-throughput ETL pipelines using Apache Spark (Scala) and Kafka. Integrated clickstream data from Redshift/SQL into Elasticsearch and Aerospike to power real-time personalization algorithms.
Workflow Automation: Developed automated data ingestion workflows using Apache NiFi, streamlining the transfer and transformation of data between Kafka streams and transactional SQL databases.
Observability & Monitoring: Implemented comprehensive system observability using Elastic APM and Coralogix. Configured critical Slack/Email alerts for API latency and error rates, significantly reducing Mean Time to Detect (MTTD) for production incidents.
System Stability: Stabilized and maintained critical legacy Java/Scala applications, ensuring 100% uptime during the high-traffic post-pandemic platform resurgence.