ANAND MATTA
Bangalore
Summary
Highly motivated Azure Data Engineer with 8 years of professional experience, including 6 years in ETL Testing and 2 years of hands-on experience in Azure Data Engineering. Proven expertise in designing and implementing scalable data pipelines using Azure Data Factory (ADF), Azure Databricks, PySpark, Apache Spark, Python, and SQL. Skilled in integrating diverse data sources including APIs, databases, and flat files. Seeking to apply expertise in ETL optimization, data automation, and cloud analytics to deliver actionable insights and drive business impact.
Overview
1
1
Certificate
Work History
Azure Data Engineer
Carelon Global Solutions
Bengulure
- Projects
- Title: PROVIDER DATA TRANSFORMATION (PDT)
- Client: Elevance Health, USA
- Description: Aims to send/receive the Providers data to BCBSA in adherence with Fast Healthcare Interoperability Resources (FHIR) standards. Rather than sending the data in traditional flat file method, this project aims to send the data via Rest API for the data exchange between the BCBSA and Elevance. This Pays the path to send and retrieve Provider data near to Realtime.
- Key Responsibilities:
- Developed and maintained Azure Data Factory (ADF) pipelines to ingest, transform, and orchestrate provider data from multiple source systems.
- Designed and implemented scalable ETL/ELT data pipelines using Azure Databricks, PySpark, and Python for healthcare provider data processing.
- Processed and transformed provider datasets into FHIR-compliant JSON resources for seamless integration with BCBSA systems.
- Performed data extraction, cleansing, transformation, and validation using PySpark and Spark SQL to ensure high-quality data delivery.
- Loaded processed data into Azure Data Lake Storage Gen2 and Azure SQL for downstream analytics and reporting.
- Implemented incremental data loading and pipeline parameterization to support efficient near real-time data processing.
- Optimized PySpark jobs through partitioning, caching, and efficient transformations to improve overall pipeline performance.
- Monitored, troubleshot, and resolved pipeline execution failures using Azure Data Factory monitoring and Azure Databricks logs.
- Worked extensively with JSON, Parquet, and Delta formats for efficient storage and processing of healthcare data.
- Collaborated with application developers, business analysts, QA teams, and solution architects to understand business requirements and implement data engineering solutions.
- Participated in Agile ceremonies, including sprint planning, daily stand-ups, backlog refinement, and sprint reviews.
- Project Details:
- Title: CMS Interoperability Mandate Solution Recommendation
- Description: The CMS Interoperability and Patient Access final rule requires CMS-regulated payers to implement and maintain a secure, standards-based Patient Access API (using Health Level 7 (HL7) Fast Healthcare Interoperability Resources (FHIR) 4.0.1) that allows patients to easily access their claims and encounter information, including cost, as well as a defined subset of their clinical information through third-party applications of their choice.
- Responsibilities:
- Understand business requirements related to provider data exchange using FHIR standards.
- Collaborate with stakeholders to identify data sources, transformation rules, and target formats.
- Analyse API specifications and data mapping between Elevance and BCBSA.
- Prepare test plans covering data extraction, transformation, and loading workflows.
- Data extraction from Oracle, MongoDB, and Cloverleaf systems.
- Execute test cases using tools like Postman, Oracle SQL Developer, and Toad.
- Perform source-to-target data reconciliation using SQL queries and MongoDB scripts.
- Work closely with development and integration teams to resolve data issues.
- Validate ETL performance under high data volumes.
- Maintain detailed test case documentation and execution logs.
- Provide daily/weekly status reports and defect metrics to stakeholders.
QA Engineer
Adecco India
- Title: Munich Re
- Client: Wipro
- Description: Reinsurance.
- Understand reinsurance business logic and data flow across systems.
- Analyse source systems, transformation rules, and target data models.
- Collaborate with business analysts and data architects to clarify data mapping and validation rules.
- Define ETL testing scope, objectives, and strategy for reinsurance data pipelines
- Prepare test data strategy for validating complex reinsurance scenarios.
- Data extraction from source systems (SQL Server, flat files, etc.).
- Transformation logic implemented in Informatica workflows and Data loading into target repositories or reporting layers.
- Perform source-to-target data validation using SQL Server queries.
- Collaborate with ETL developers to triage and resolve issues.
- Validate ETL job performance under large reinsurance data volumes.
- Maintain comprehensive test case documentation and execution logs and share daily/weekly test status reports and defect metrics with stakeholders.
Education
Master of Computer Application (MCA) -
Sree Vidyanikethan Engineering College
Tirupati, India01-2013
Skills
Certification
Jul 2021 - Certified Cloverleaf Analyst
Timeline
QA Engineer
Adecco India
Azure Data Engineer
Carelon Global Solutions
Master of Computer Application (MCA) -
Sree Vidyanikethan Engineering College