• Currently working on designing and developing Id link patient project, including Spark Job, database design and ingesting aggregated patient using Kafka.
• Designed and developed Spark job using Scala for curating clinical data, including various stages for identification, resource linking, policy application, finding best match and aggregation of clinical data like medications, observations, etc.
• Led curation performance teams to improve performance of curation job with combination of algorithm and spark perf tuning to successfully hit SLA to process 2B ontologies within 12 hours.
• Leading a team to develop second generation job service with state machine for better scalability and monitoring using mass transit.
• Led cross team effort for integration of various component of conveyor belt and job service and performance of job service and spark batch job performance.
• Led team for various POC to analyze cost benefits, performance and mitigate scalability issues e.g. DB Scaling Tiers, Azure Data warehouse etc.
• Responsible for Planning Sprints, Brainstorming, Story Breakdown, Estimations, Daily Standups, Design, Code, and Test Plan Reviews, Coding, Unblocking Teams, and Conducting Sprint Retrospectives
• Mentored Junior and Mid-Level developers by means of code reviews and pair programming exercises to help them understand and implement newer technologies.