# Jai M > Data Engineer | Azure Data Factory, Databricks, PySpark, Delta Lake | AWS & Snowflake | AI/ML Pipeline Engineering | Cloud Data Engineering | GenAI & MLOps Location: United States, United States Profile: https://flows.cv/jaim Data Engineer with 4+ years of experience building scalable batch and streaming data pipelines on Azure and AWS for banking and financial services. I specialize in designing end-to-end ETL/ELT solutions using Azure Data Factory, Databricks, Synapse Analytics, Delta Lake, PySpark, and SQL — processing 10M–20M+ records to power analytics, machine learning, and regulatory reporting. My core work spans cloud data engineering, dimensional modeling (Star/Snowflake Schema, SCD Type 1 & 2), medallion architecture, and data warehousing on Azure SQL, Redshift, and Snowflake. I've built 30+ automated pipelines with event-driven orchestration, cutting processing times by up to 45% and manual effort by 70%. I also build data infrastructure for AI/ML workflows — feature stores, model-ready datasets, A/B testing frameworks, anomaly detection pipelines, and experiment tracking — collaborating with data science and risk teams to deploy production models. Domain expertise: AML/BSA compliance, fraud detection, credit risk analytics, and regulatory reporting in banking. Currently exploring Generative AI, LLM integration, and MLOps to extend data engineering into the next generation of intelligent data systems. Open to opportunities in Cloud Data Engineering, Azure Data Engineering, AI/ML Engineering, and GenAI-powered data platforms. ## Work Experience ### Software Engineer/Data Engineer @ IDB Bank Jan 2024 – Present | New York City Metropolitan Area Designed scalable ETL/ELT pipelines using Azure Data Factory and Azure SQL Database across 10M+ banking records, improving processing performance by 30% Built optimized SQL data models, stored procedures, and views powering real-time Power BI dashboards for compliance and operations stakeholders Implemented SCD Type 1 & 2 dimensional models for AML/BSA regulatory reporting with automated incremental load management Engineered feature pipelines for anomaly detection and fraud monitoring using SQL, Python, and PySpark, reducing false positives by 15% Led A/B testing data frameworks and experiment-tracking pipelines enabling statistically validated decision-making Maintained end-to-end data lineage documentation across 25+ audit-ready deliverables with 99.5% completeness via Unity Catalog ### Software Engineer/Data Engineer @ Infosys Jan 2022 – Jan 2023 | Telangana, India Built cloud data pipelines using Azure Data Factory, Data Lake Gen2, Synapse Analytics, and Databricks processing 20M+ records monthly Developed batch and near real-time pipelines with PySpark, Auto Loader, Delta Lake, and Delta Live Tables for ML and analytics workloads Implemented event-driven orchestration with ADF triggers and Databricks Workflows, reducing cycle time from 2 days to 4 hours Built medallion architecture data layers (Bronze/Silver/Gold) supporting analytics and regulatory reporting ### Software Engineer/Data Engineer @ Tata Consultancy Services Jan 2021 – Jan 2022 | Telangana, India Designed end-to-end ETL pipelines on AWS using S3, AWS Glue, and Amazon Redshift for enterprise reporting Built automated financial reconciliation workflows achieving 98% match accuracy and reducing manual effort by 50% Developed Power BI dashboards connected to Redshift supporting 6+ operational workflow ### Software Engineer @ PROGMENT SOFTWARE TECHNOLOGIES PRIVATE LIMITED Jan 2020 – Jan 2021 | India • Designed and developed ETL pipelines and data architectures to streamline data ingestion and reporting processes. • Leveraged SQL and BI tools to create dashboards, performance metrics, and reports for client requirements. • Engineered data acquisition processes, handling both batch data at rest and streaming data to enable real-time data availability and system integrity. • Identified and implemented process improvements to enhance the reliability and scalability of ETL workflows. ## Education ### Master of Science - MS in Information Technology Saint Peter's University ### Bachelor of Technology - BTech in Electrical and Electronics Engineering SRKR Engineering College ## Contact & Social - LinkedIn: https://linkedin.com/in/jai-m-433741395 --- Source: https://flows.cv/jaim JSON Resume: https://flows.cv/jaim/resume.json Last updated: 2026-04-05