Worked as part of Apigee Insights Platform, providing customers with tools and modules to process large datasets of events and entities. These tools and applications are built on top of big data technologies including Cassandra, Hadoop, Map/Reduce and AWS. Specific tasks include -

* ingest/import large data sets of events into Insights Platform built on top of Cassandra

* analyze different API metrics and business insights using Hadoop Map/Reduce

* create easily deployable custom map/reduce modules for common use cases

* Lead the analysis of different performance issues related to RISE (Rapid Iterative Search Engine) system. Analysis was done both at the system and application levels. This involved benchmarking different hardware systems, thread configurations, application containers and workflow management systems.

* Implemented an extensible framework to gather the performance metrics. This framework was also used to gather the metrics on nightly builds. This helped the team to identify problems very quickly.

* Improved performance of Mixer (REST based Web Services API) to scale the number of simultaneous connections using Asynchronous Servlets model.

* Designed and implemented commenting support for vitality feeds to integrate with Yahoo! Messenger.

* Designed and implemented broadcaster enhancements to support cross-post of vitality feed on to other third party social networking sites like facebook and twitter.

* Designed and developed a pipeline to gather huge unstructured data sets from different servers and components.

* Implemented modules for processing the data using Distributed Computing technologies such as Hadoop and PIG to get key analytics on Yahoo! Small Business products and customers.

* Identified and fixed the bottlenecks and performance issues related to the existing message queuing mechanisms (backbone communication piece for the Yahoo! Merchant Solutions system).

* Worked on defining the data base schema for the Yahoo! Small Business teams central database (Domains Database) to move from legacy system to MySQL and provided APIs

* Designed and implemented a multi-tiered REST based web service to interact with the control panels.

* Worked on multiple projects involving Yahoo! Small Business Store/Hosting Business Continuity Planning (BCP) setup to build fault-tolerance and self-healing applications to recover from failures or disasters

* Designed and implemented Abuse Prevention and Active Scan module (an internal web application) to manage geocities abuse feeds in order to reduce the spam across the free Geocities sites that resulted in 40% reduction of customer care call volume.

* Acted as the single point of technical support to Small Business India team (remote team) in identifying the requirements, reviewing the design, training the team and troubleshooting in the project to provide Small Business Services in India.

* Worked on many Continuous Integration initiatives to stabilize builds and add code coverage