As part of the AWS Database and Analytics team I was the sole designer responsible for AWS Glue and AWS Lake Formation.
Working closely with product management and engineering to understand the customers, business goals, timeline and priorities, and technology capabilities, I delivered user research, requirements analysis, design ideation, concept wireframes, interactive prototypes, detailed design assets, and customer validation on an aggressive schedule.
During this period we introduced over 30 new features in Glue, added 15 additional regions of availability, and built an entirely new service in parallel with Lake Formation.
Significant Glue features introduced included: support for DynamoDB tables as a data source, Amazon SageMaker notebooks for development endpoints, resource tagging, Workflows for ETL orchestration, job bookmarks for Parquet and ORC files, FindMatches ML transforms, custom SSL certificates for JDBC connections, rewind job bookmarks, and custom JDBC drivers.
As a new service, AWS Lake Formation builds upon the Glue data catalog, workflow orchestration, and ETL job infrastructure, creating Blueprints that simplify and automate data lake ingestion. It extends the data catalog with user defined metadata, allowing for rich data discovery by end-users. And it adds a powerful access control system where permissions are granted and revoked for users, groups, and roles to data at the table, column, or row level. All data lake activity is logged for compliance and auditing purposes.