Currently, I am working on a cloud-based ETL product, trying to connect data from various data pipelines and performing transformations using spark program. The framework utilizes hadoop as a persistence layer for intermediate data and Alluxio as a distributed caching layer. Hive is used to query external data ingested by the data pipelines.

I also help mentoring junior developers, guiding them through various phases of a project, from start to finish.

Involve in extending, refactoring, and developing various features/modules of the open-sourced Terracotta Distributed Shared Object (DSO) product. DSO is a highly scalable and concurrent product and provides a drop-in solution for clustering multiple JVM without requiring a java application to program against a specific API.