Datalake

Recursive CTE

Disk Caching(C3)

Results Caching

Variant datatype

Data Infra and Analytics

* Exabyte scale analytics for Facebook, Instagram, Whatsapp data with Spark compute engine. Facilitating and redesigning pipelines for Ads targeting, large scale indexing services and k-NN classification.

* Architected native lineage generation for all analytics and ML pipelines in Spark query processing. Privacy enforcement in compute engines for regulatory compliances around the world.

* Setting direction with cross functional collaboration, prioritizing plans and delivering Spark privacy projects to completion before time and meeting 50+ government compliances around the world.

Adobe Experience Platform - Real Time Customer Data Platform

* Launched B2B customer profile unification project spanning multiple teams and business units. Drove the architecture involving customized backend with query processing engine, cosmosDB storage, data preparation pipelines and spark execution clusters.

* Marketo engage revenue cycle analytics : Guided engineering and DBA teams in reviving the analytics suite and recaptured licenses with large renewals worth $30 million ARR.

* Architected bootstrap mechanism from flat files to seed databases and log structured merge trees storage. Led porting team to bring postgres pl/pgsql constructs(maps & arrays) and transaction processing on par with oracle pl/sql to enable the platform to replace oracle with inexpensive postgres.

* Proposed and architected XACML based RBAC (role-based access control) and ABAC (attribute-based access control) policy engine for high volumes of standard, custom and external objects for the core salesforce platform.

Geographically distributed database query processing