A Software Engineer driven by the mission to build large-scale projects that can impact billions of people! At Everlaw, I specialize in full-stack development and performance optimization, enhancing complex software solutions across cloud-based platforms.

Experience

EverlawSoftware Engineer

2023 — Now

Oakland, California, United States

Managed the end-to-end development of a large-scale enterprise data platform designed to ingest billions of documents, enabling fast search and real-time collaboration, powered by Java/Spring Boot, Hibernate, Python, AWS EC2/S3, and React/Dojo.

Built and maintained a compliance orchestration service managing millions of data owners with event-driven pipelines handling millions of notifications monthly.

Enhanced a Python- and AWS-based ETL pipeline for data parsing and metadata extraction, supporting 100+ file types, and optimizing metadata capture to streamline upload workflows.

Carnegie Mellon UniversityResearcher

2022 — 2022

Initialized an automated pipeline using Azure Container Instances and Azure Functions for running university research codes, addressing low automation, low maintainability, and high operational costs.

Integrated existing research codes into the designed pipeline manually, ensuring compatibility and seamless migration.

TuSimpleSoftware Engineer Internship

2022 — 2022

San Diego, California, United States

Cloud task scheduler

Developed a company-wide task scheduler in Python to perform cloud computing tasks on Amazon EC2 Instances, handling up to ~6,000 tasks per second and 4,000 instances through EC2 spot fleet.

Minimized workload cost by implementing a task scheduling algorithm to dynamically adjust instance size and instance computing power, based on task count and resources needed per task.

Decreased ~2.5% instance utilization by diminishing redundant instance initialization, reducing ~$15k budget monthly.

Internal tool

Implemented a Python and SQL based solution to optimize the database scripting efficiency for updating mass data.

Developed a wrapper API in Python to batch transactions concurrently for database scripting, increasing speed by 4x and reducing 80%+ memory use.

Logged data changes and transaction events using PG/plSQL, and developed a log-based rollback function to assist with batch scripting; visualized logs in a tabular view by developing 4 web pages in Vue.js.