Building Stargate, Mr. Kubernetes

▪ Hold office hours and guide students through topics such as Policy Gradient Methods (PPO, TRPO, NPG), Deterministic Policy Gradients (DDPG), Evolutionary Methods for Policy Search, and Model-Based RL. I also cover more foundational topics like Multi-Armed Bandits, Monte Carlo methods, Temporal Difference Learning, and exploration techniques such as Thompson Sampling and UCB

▪ Developed EC2 console widget, leveraging AWS services and CDK to architect a scalable backend infrastructure consisting of Lambda, DynamoDB, and API Gateway.

▪ Applied two newly inherited frameworks, the widget framework and EC2 test console framework; and implemented tool to alert users of the statuses of their EC2 requests in real time; previously no support for notifying user of failed launches.

▪ Assisted senior engineers by guiding the setup of new widget development environments; created documentation on communication protocols between the two systems to simplify future development processes.

▪ Mentored a community of 200+ residents over 2 years; hosted events w/50+ residents in attendance

▪ Developed automation tool to seamlessly merge and synchronize sensor data across the lab’s measurement devices: gas chromatograph, PTR-MS, gas concentration analyzer, and lab jack

▪ Implemented a low-cost regression model (~$150) utilizing statistical software such as R, pandas, and Excel; achieved comparable performance to a high-end methane sensor worth $20,000.