• Enhanced Python ETL scripts to increase reusability and applicability across multiple use cases, improving efficiency and reducing redundancy
• Developed and updated comprehensive runbooks and documentation for ETL scripts to ensure ease of use and knowledge transfer for team members
• Collaborated with a colleague to deliver a live demo in a team meeting, showcasing the functionality of enhanced ETL scripts. Gathered feedback for potential future improvements
• Led an end-to-end project on recruitment data, leveraging:
• Azure Data Factory: Designed and implemented pipelines to transform raw recruitment data into gold tables based on business requirements
• Azure Synapse Analytics: Created views for streamlined data analysis
• Azure Data Lake Storage: Managed bronze, silver, and gold-tier data for efficient storage and processing
• Azure Tables: Used to store configuration data for the pipelines
• Authored detailed runbooks and project documentation, including challenges faced and solutions implemented, to support future projects and ensure continuity