1. Apache Kafka as a Service:
• I am involved in various cycles of design and development of highly scalable, distributed and multitenant
managed platform that provides Apache Kafka processing on Oracle Cloud.
• Added a REST layer which includes a schema cache to send/receive structured messaging through kafka.
• Implemented an interface which provides OAuth2 authentication with role based authorization for accessing
kafka topics over HTTP as well as TCP.
• Developed a custom Async REST Kafka Connector for orchestration of SaaS Applications on Oracle Cloud.
• Currently working on Docker containers based multi-tenant connector framework for kafka service.
2. Big Data as a Service:
• I developed a secured REST layer that provides an easy access for submitting batch and interactive Spark Jobs
using resource manager YARN.
• I added a library functionality using which Spark Jobs can access jars or python libs required for running the job
from Oracle Cloud Storage as well as HDFS.
• Added a low priority Spark job to upload job logs to Oracle Cloud Storage from HDFS.