•Developed and maintained scalable backend data pipelines using Go to handle business logic and data ingestion for user accounts, class schedules, and rostering management, ensuring high performance and reliability.
•Implemented server-less architectures with AWS Lambda to automate and streamline data processing and data pipelining tasks, including event-driven updates and integration with external EdTech systems like Clever, ClassLink, Edlink and OneRoster.
•Designed and optimized relational databases in MySQL, managing and querying data related to user profiles, class assignments, and scheduling, resulting in improved data retrieval times and system efficiency.
•Worked with Devops teams to set up HoneyComb tracing and setup AWS Cloudwatch dashboards for monitoring improving observability into Data platform.
•Refactored and cleaned up legacy code within the rostering data pipeline to improve maintainability and pipeline ingestion performance, ensuring compatibility with modern technologies and reducing technical debt.