• Built and improved numerous LLM-driven systems, including LLM-as-Judge evaluations, Eval generation, Eval Grading and Calibration, and Test Case Generation

• Performed various prompt engineering and model fine-tuning experiments to hone our prompt performance strategy

• Created several new pages and redesigns for various monitoring flows, including our Leaderboard, Project Dashboard, Prompt Template Dashboard

• Designed and implemented our LLM call cost tracking system, making requisite changes throughout our application, database, and SDKs

• Created a simple web-based MCP Client and MCP Server

• Built a POC to integrate CloudFlare logs into our eval generation workflow

• Significant overhauls and redesigns of several data-heavy UI tables throughout the application

• Improved our testing apparatus with several Checkly E2E tests (written with Playwright) for core UI flows

• Collaborated with our designer, product manager, and CEO for new page and component designs

• Various other API, database, and UI features

Tech: Next, React, Node, Postgres, Temporal, Timescale, VisX, GraphQL, Hasura, OpenAI, Claude, Gemini, HuggingFace, Checkly, Playwright, ChakraUI, tRPC, TanStack Table & React Query

• Developed and refined a variety of full-stack web applications (React / Typescript / Redux / Next / SCSS / Node / GraphQL / Postgres) for both startups and Fortune 500 companies, including a media-based event discovery platform, several video-centric live event websites, and a commercial real-estate analytics platform

• Advised clients and team members on a variety of matters, including technical architecture decisions, UI/UX best practices, and technical details of pursuing Web3 opportunities and the crypto landscape

• Wrote smart contracts, NFT minting protocol, and crypto payment integration for a decentralized music licensing startup based on the Algorand Network

• Created data visualizations using Highcharts to demonstrate a variety of economic trends

• Developed and refined a variety of full-stack web applications (React / Typescript / Redux / Next / SCSS / Node / GraphQL / Postgres) for both startups and Fortune 500 companies, including a media-based event discovery platform, several video-centric live event websites, and a commercial real-estate analytics platform

• Advised clients and team members on a variety of matters, including technical architecture decisions, UI/UX best practices, and technical details of pursuing Web3 opportunities and the crypto landscape

• Wrote smart contracts, NFT minting protocol, and crypto payment integration for a decentralized music licensing startup based on the Algorand Network

• Created data visualizations using Highcharts to show a demonstrate a variety of economic trends

• Worked on a variety of projects and tech stacks, including: re-envisioning our cryptocurrency exchange's onboarding and Know-Your-Customer processes, adding the ability to use wires and credit cards for fiat deposits/withdrawals, and integrating cryptocurrency capabilities into the company's crowdfunding platform

• Created, developed, and ran multiple A/B tests via Google Experiments

• Refactored and improved Mixpanel implementation and event coverage

• Developed multiple JavaScript libraries and Vue/VueX components for UI features, as well as PHP and Django APIs

Tech: Vue, PHP, JavaScript, JQuery, Django, Python, Git, Mixpanel, CSS, HTML, Google Experiments, Postgres, MySQL, InVision, Zeplin