Experienced working in Enterprise Data Lake. Built multiple Data pipelines using different AWS Resources and Databricks. Experienced in Developing Analytics dashboards using Tableau. Developed React apps for Application Availability Monitoring. Gathered data from different sources for FinOps reporting.
•Aligned $30 million in Databricks, AWS, and Palantir compute and storage spend to applications and their owners in Databricks SQL tables stored in DynamoDB
•Developed AWS lambdas to prevent the misuse of tagging for AWS compute clusters and to craft JWT tokens to embed Tableau dashboards into React micro frontends for application owners to view their costs.
•Implemented cost anomaly detection for Databricks compute jobs for automatic email alerts to application owners for unusually expensive job runs.
•Implemented new data pipelines to assign cloud cost and usage metrics essential to determine billing as well as CI/CD pipelines for easy tracking of deployments