One of the early phase engineer to conceive and architect Cortex platform that provides high throughput, multi-tenant data-lake in cloud, and an echo-system of diverse set of applications and services that operate on it.
Designed and created Cortex Platform using Istio (envoy), kubernetes, docker, gRPC, kafka on GCP, GCP Resources like Deployment Manager, Cloud Composer ( Apache Airflow ), BigQuery , Cloud SQL to create and manage resources for multi-tenant micro-services
Use of Hadoop/spark/big data frame works to migrate on-prem data to cloud
Efficient use and update of Kafka topics to manage millions of events coming per second.
Part of the team for security visualization and analytics product which analyzes petabytes of data. The team implemented everything: infrastructure, backend, React frontend. Product heavily used by thousands of customers for visualization, notification and reports.
Solutions provided using:
Java, Microservices, REST, MYSQL, REDIS, Logback/Slf4J, Swagger, JUnit, Mockito, Jacoco, GCP ( Bigquery, cloudsql, deployment manager, cloud build, dataflow), Prometheus, Grafana, Kafka, Apache Airflow, Jenkins, Gradle, Spring boot, Hadoop,Spark,Istio (envoy), kubernetes, docker, gRPC,