Open Source Contributor - Apache Hudi (Open Data lakehouse)

Core Contributor - Optimizations related to Apache Spark, Query Execution and overall Onehouse Product.

My responsibilities include:

• Providing academic support to a cohort of 150+ students in CSE 4/560 - Data Models and Query Language, clarifying doubts and enhancing their understanding of Relational Algebra, SQL, ER Models, Normalization, Indexing, Transactions, Hashing, Locking, Concurrency Control, and Recovery Algorithms.

• Assisting in designing and grading project, assignments focused on database design, query optimization, and transaction management, ensuring students grasp core database concepts and real-world applications.

• Developing and distributing lecture materials, project handouts, and SQL practice problems to reinforce learning.

• Managing exam logistics, proctoring, and maintaining student performance records.

• Collaborating with the instructor to update course content, create new problem sets, and enhance coursework to align with industry standards.

My responsibilities include:

• Provide academic support to a cohort of 250+ students in the CSE 4/587 - Data Intensive Computing course, helping to clarify doubts and enhance understanding of complex topics including Machine Learning, Data Science Life Cycle, Hadoop, HDFS, Spark, and Spark Streaming.

• Grade projects, homework, and assignments, delivering timely and constructive feedback to foster student improvement.

• Assist in preparing and distributing course materials, such as lecture notes and project handouts, ensuring alignment with course objectives.

• Maintain accurate records of student grades and manage logistics for exams, including scheduling and proctoring to ensure smooth course operations.

• Support the instructor in developing, updating, and refining course content, assignments, and projects, contributing to the planning and execution of course activities to enhance the learning experience.

Researcher and Full Stack Engineer at Data Intensive Distributed Computing Lab contributing to One Data Share project.

Devised core services for OneDataShare, including a Single Sign-On feature for social and organizational logins using OAuth2 and OIDC Security Protocols. Optimized cross-platform data transfer through Bayesian Optimization, DDPG, and PPO by 90% predicting optimized transfer parameters.

Worked on reducing carbon footprint for AI models with architectural improvements and split machine training with efficient routing for back propagation.

Performed detailed geographical location and address annotations ensuring data integrity and accuracy across large postal databases.