Sunnyvale, California, United States
Redesign and modernize the infrastructure for Yahoo Mail Anti-spam with the aim of migrating
services with zero downtime. Some notable projects include:
* Outbound mail classification service that classifies millions of outgoing emails per day as they are composed.
* Vote Processor that handles a stream of user spam/not spam votes and provides feedback to classification algorithms in order to improve user experience.
* Designed and implemented a framework for consumer-as-a-service that makes it seamless to develop and maintain new components that consume data from a distributed messaging and streaming platform. The framework provides a unified way of config management, logging, metrics, integration tests and deployment to Kubernetes.
* Built BigData pipelines using Hadoop, Hive, HBase to generate reputations for email senders.
* Reduced spam in users’ Spam folder significantly by developing algorithms for the Traffic Shaping System that controls and rate limits incoming mail traffic.
