Hemavathi B
Bengaluru
Summary
Azure Data Engineer with 2 years of hands-on experience in building and supporting cloud-based data pipelines using Azure Data Factory, Azure Databricks, PySpark, and SQL. Strong expertise in ETL/ELT development, data migration, transformation, and validation, delivering analytics-ready datasets at scale. Experienced in working across insurance, pharmaceutical, and energy domains, with a proven ability to collaborate in Agile environments and support enterprise-level data solutions.
Overview
5
5
years of professional experience
4
4
years of post-secondary education
Work History
Senior Engineer
Aspire System
Bengaluru, India
10.2024 - 01.2026
- Designed, developed, and maintained end-to-end Azure data engineering pipelines for enterprise clients using Azure Data Factory (ADF), Azure Databricks, and ADLS Gen2.
- Implemented PySpark transformation logic in Azure Databricks to cleanse and standardise large datasets for downstream analytics.
- Optimised Spark jobs through partitioning, caching, and efficient joins, enhancing pipeline performance and reliability.
- Built parameterised and reusable ADF pipelines to ingest data from relational databases, flat files, and cloud storage into Azure Data Lake.
- Managed structured and semi-structured data in Azure Data Lake Storage Gen2 and Blob Storage, adhering to enterprise data lake best practices.
- Performed data validation, reconciliation, and quality checks to ensure accuracy and consistency across source and target systems.
- Implemented error handling, logging, and monitoring in ADF pipelines to improve operational stability.
- Supported data migration initiatives from on-premise and legacy systems to Azure cloud platforms.
- Worked in Agile environments, participating in sprint planning, stand-ups, and production support activities.
- Assisted in deployment coordination and version control using Git, ensuring smooth promotion across environments like dev, and production.
Project Coordinator
Oprimes
08.2023 - 01.2024
- Coordinated project activities to ensure the timely delivery of data-related initiatives.
- Collaborated remotely with developers, testers, and stakeholders using Agile tools.
- Supported Azure-based environments by monitoring data refresh schedules and reporting issues to engineering teams.
- Validated data outputs, test results, and ETL job executions for data teams to enhance data integrity.
- Executed SQL-based data checks to ensure the accuracy of application and reporting data.
- Performed manual testing of data-driven applications and dashboards.
Intern
Qualitrix
03.2021 - 09.2021
- Collaborated with senior engineers on data preparation, validation, and transformation tasks to ensure data integrity.
- Worked with SQL queries to extract and validate datasets for internal use.
- Contributed to ETL workflow documentation and learned best practices in data handling for improved project clarity.
- Developed an understanding of data pipelines, storage concepts, and analytics workflows in an enterprise environment.
- Acquired foundational knowledge of cloud-based data platforms and Azure concepts to support team initiatives.
- Built strong fundamentals in IT processes, teamwork, and professional communication.
Education
bachelor of engineering - Electronics and communication
Vivekanada College of engineering and Technology
Puttur, KA 08.2016 - 09.2020
Skills
- Azure Data Factory (ADF), Azure Databricks, ADLS Gen2, Blob Storage
- Python, PySpark, SQL (MySQL, Spark SQL)
- ETL pipelines, data ingestion, transformation and validation
- Batch data processing, data migration to Azure cloud
- Apache Spark, Performance Optimisation (basic)
- Git, GitHub, Agile, and Scrum
Timeline
Senior Engineer
Aspire System
10.2024 - 01.2026
Project Coordinator
Oprimes
08.2023 - 01.2024
Intern
Qualitrix
03.2021 - 09.2021
bachelor of engineering - Electronics and communication
Vivekanada College of engineering and Technology
08.2016 - 09.2020