Maintained streamlined pipeline enabling business users to deploy Python code while adhering to best practices and security standards, resulting in improved efficiency and compliance and allowing users to have fully automated processes
Engineered ETL pipeline utilizing Python and shell scripts with AWS EMR and S3, optimizing data processing and storage capabilities, reducing data processing time, and improving data accuracy
Facilitated cross-team collaboration to gather ETL requirements and synchronize deployments with ongoing changes, ensuring seamless integration and alignment with project objectives.
Collaborated with users to modernize data processes, creating AWS Lambda with Python and Pandas to automate data transformation and improve data security, freeing users from manual tasks and expanding data analysis capabilities
Developed Python library to streamline integration of enterprise libraries and tools for service users, reducing onboarding time and improving user experience