Full stack developer, been building tools for while.
2021 — Now
San Francisco, CA
Internal Developer AI
Working on Google's internal AI developer tool, trained on internal data, I contributed to model improvements and tool improvements, with my primary focus being creating our evaluation solutions. The tool achieved 1M queries per day and MAU of over 30k before my departure.
Implemented our evaluation metrics for our offline eval system.
Managed our offline eval system usability and improvements.
Designed and created our online evaluation framework.
Implemented serval autoraters (LLM and non-LLM based) which assess different stages in our tool's Question to Answer journey.
Evaluated, and drove autorater confidence, leveraging those with high confidence to make product decisions, such as the configuration for how our tool fetches context. This enabled ~10% lift in the ability in the fetching the context to solve a user query.
Lead the end-to-end dataset creation, improvement, and human vetting.
Leveraged our A/B test framework to contribute improvements to our tool through system instruction changes and RAG+tool upgrades.
Contributed back into our models through Golden evaluation sets (added to fine tuning) and using autoraters as loss indication metrics during training.
Developer Graph
I contributed to our Knowledge Graph system which aims surface answers to developer workflow questions. By bringing useful and relevant data to the current developer surface, we reduced context switching and hopping between different tools, raising engineer productivity.
An integration I released was with Android deployment data, Code versioning data and Build data, allowing us inform engineers when their changes reached various release environments. This involved bringing in partner data, managing data contracts, as well as backend logic changes for ETL over our knowledge graph.
San Francisco Bay Area
On the Advertising Tools team, building backends by designing APIs with MySQL database to communicate to a React/Mobx front end which I also shared responsibility building.
Used Ant Design and created custom components to bring to life UX design specifications. These contributed to app screens for performing CRUD on Ad messages or Ad forecasting reports and various other projects
Worked with King services, communicating from our servers to theirs and implementing business logic, such as Object conversion and data syncing to a generic model on our service.
2018 — 2019
San Francisco Bay Area
Working on both server (Java) and client code (Typescript as well as in Unity with C#) to make games for mobile devices.
Wrote client logic and UI code as well as animations, for example, animating a game board and then tweaking the configurations based on user feedback to provide a better experience. Contributed global meta features like Lives, In game currency etc. as well as game specific features, i.e. game boards, pieces and their interactions
Collaborating on shared internal SDK for game teams. This SDK would help other game teams as well as ours, introduce a chat feature into the game.
2015 — 2018
London, United Kingdom
Shared Tech/Tools team
Built web applications and stand alone tools to help game teams in their day to day and key parts of the mobile game development life cycle. Mainly using Angularjs, Java, Mysql with various build tools and continuous integration tools.
User Acquisition Team
Working with advertising on the Facebook platform, building an application that interfaces with the Facebook marketing API and in-house tools to create an application to automatically tune spending on advertisements
Hursley, Hampshire
CICS (Mainframe) Test automation tools team
Front end projects using Javascript, HTML5, CSS, Dojo Toolkit with IBM's idx extension to create UI of web app calling REST apis to display automated test result data. Made back end changes to accommodate new display needs. Took into account user feedback, user studies, and IBM Design techniques (Human-Centred), from prototyping into refinement through surveys and observations
Education
2011 — 2015
Imperial College London
Master of Engineering (MEng)
2011 — 2015
2004 — 2011
Ilford County High School
High School
2004 — 2011