Summary
Overview
Work History
Education
Skills
Timeline
Generic

Dharma V

Azure Data Engineer
Bengaluru

Summary

● Results-driven and detail-oriented Azure Data Engineer with 3.7 years of professional experience in designing, building, and optimizing data pipelines and ETL processes using Azure Data Factory, Azure Databricks, and PySpark .

● Proficient in Python scripting, SQL Server developmentand integrating on-premise and cloud data sources for scalable data solutions.

● Strong expertise in Data Warehousing, Data Modeling, and developing robust ETL frameworks to support analytical and operational reporting needs.

● Experienced in implementing business intelligence solutions using Power BI, SSIS, and SSRS to deliver insights and data visualizations across business units.

● Proficient in developing and automating end-to-end data pipelines on Azure using ADF and Databricks, integrating various structured and unstructured data sources.

● Hands-on experience in writing scalable and optimized PySpark code for large-scale data processing and implementing data transformation logic.

● Strong skills in Python for data ingestion, automation scripts, and integration with cloud services.

● Designed and implemented ETL workflows using Azure Data Factory, SSIS, and Databricks, ensuring timely data availability for business-critical applications.

● Expertise in Data Modeling (Star & Snowflake Schema) and designing scalable Data Warehouse solutions on Azure SQL and Synapse Analytics.

● Strong command over SQL Server including development of T-SQL scripts, stored procedures, functions, views, and performance tuning.

● Experience in developing interactive dashboards and reports in Power BI, enabling stakeholders to derive actionable insights.

● Developed SSRS reports for operational and analytical reporting requirements and integrated them into business systems.

● Built and maintained SSIS packages for data extraction, transformation, and loading from various data sources like flat files, Excel, SQL Server, and REST APIs.

● Knowledge of CI/CD pipelines, version control (Git), and integration with Azure DevOps for deployment automation.

● Strong understanding of data governance, security, logging, and monitoring in a cloud environment.

● Collaborated closely with business analysts, data scientists, and end-users to understand data needs and deliver value-added solutions.

● Experience with incremental loads, data partitioning, delta lake tables, and performance tuning in Databricks.

● Adept in troubleshooting data issues, performing root cause analysis, and implementing effective resolutions.

● Good understanding of Spark Architecture, Transformations and Actions.

● Excellent knowledge of ADF building components – Integration Runtime, Linked Services, Data Sets, Pipelines, Activities.

Overview

4
4
years of professional experience

Work History

Azure Data Engineer

Ascension Health
06.2023 - Current
  • ● Spearheaded the design and development of ETL / ELT Azure data pipelines using Synapse Analytics, redesign SSIS pipelines, and database objects for the implementation of cloud data warehouse.
    ● Applied expertise for creating data pipelines to extract, transform and Load student and healthcare data for the university colleges to data lake house for analysis by the end users.
    ● Demonstrated proficiency in Implementing integration points between Oracle data loaded into Azure Data Lake storage – ADLS Gen2, blob storage and other source systems such as API calls.
    ● Successfully building ETL data pipelines with Azure Data Factory, Azure Synapse, SQL Server, T-SQL, SQL pool and Serverless pool objects – external tables, views for the data lake house design implementation.
    ● Effective implementation of data acquisition, validation, curation and ETL Process utilizing Spark, SQL, PySpark, and SQL notebooks.
    ● Creating and managing data mapping and transformation routines to ensure data accuracy and consistency.
    ● Monitoring integrated systems for performance optimization, tuning ETL pipelines, and automation opportunities.
    ● Creating documentation and providing training and support to end-users, administrators, and support teams.

Azure Data Engineer

The Hartford
12.2021 - 05.2023

● Development of pipelines, linked services, and datasets in Azure Data Factory version 2.

● Migrated data from REST API and FTP links to Azure SQL Server.

● Engaged in various applications involving both development and support project activities.

● Developed Azure Data Factory pipelines to transfer data from source to target systems.

● Participated in deployment activities and transitioned code across different environments.

● Migrated data from the client data scope to Azure SQL Server and Azure Data Lake Gen2.

● Created various ADF pipelines to fulfill business requirements.

● Configured Azure Key Vaults within ADF.

  • Optimized data processing by implementing efficient ETL pipelines and streamlining database design.

● Loaded data into a target Data Lake in CSV and Excel formats.

● Designed data-driven workflows for data movement and transformation using Data Factory.

● Executed basic transformations while transferring data from staging to the final data mart.

● Extracted data from on-premises MySQL source systems to Azure Data Lake Storage.

● Implemented data ingestion pipelines from multiple data sources utilizing Azure Data Factory.

Azure Data Engineer

TCS
12.2021 - Current

Education

Bachelor of Science - Electronics And Communication Engg

Presidency University
Bengaluru, India
04.2001 -

Skills

  • Azure Data Factory
  • Azure Databricks
  • Azure Synapse
  • Azure SQL
  • PySpark
  • Python
  • SQL Server
  • Power BI
  • SSIS
  • SSRS

Timeline

Azure Data Engineer

Ascension Health
06.2023 - Current

Azure Data Engineer

The Hartford
12.2021 - 05.2023

Azure Data Engineer

TCS
12.2021 - Current

Bachelor of Science - Electronics And Communication Engg

Presidency University
04.2001 -
Dharma VAzure Data Engineer