Harikumar Reddy
Hyderabad
Summary
Azure Data Engineer with 2 years 10 months of experience in designing, developing, and supporting cloud-based data solutions on Microsoft Azure. Strong hands-on experience in Azure Data Factory (ADF) for building end-to-end ETL pipelines, including full and incremental loads, transformations, parameterization, scheduling, and error handling. Proven expertise in integrating ADF with Azure Data Lake Storage Gen2 and Snowflake to deliver scalable, analytics-ready data solutions. Experienced in implementing cloud monitoring and incident management using Azure Monitor, Log Analytics, alerts, and ServiceNow. Actively involved in handling P1/P2/P3 production incidents, performing root cause analysis (RCA), and ensuring SLA compliance. Strong knowledge of data staging, performance optimization, and security best practices, including Azure Key Vault and Managed Identity. Skilled in collaborating with cross-functional teams to ensure high availability, reliability, and performance of data pipelines and cloud services.
Overview
3
3
years of professional experience
1
1
Certification
Work History
Azure Cloud Support / Monitoring Engineer
HCL TECHNOLOGIES
10.2022 - Current
- Implemented and managed Azure cloud monitoring and incident response for data and application workloads using Azure Monitor, Log Analytics, and Alerts, ensuring high availability, performance, and rapid issue resolution across Azure services.
- Configured Azure Monitor to track performance, availability, and health of Azure resources.
- Created Log Analytics workspaces and KQL queries to analyze logs and metrics.
- Implemented metric and log-based alerts for Azure Data Factory, Azure SQL DB, Storage Accounts, and Virtual Machines.
- Monitored ADF pipeline failures, long-running activities, and trigger issues.
- Integrated alerts with ITSM tools (ServiceNow) for automated incident creation.
- Handled production incidents (P1/P2/P3) related to data pipeline failures, connectivity issues, and performance degradation.
- Performed root cause analysis (RCA) and implemented permanent fixes.
- Coordinated with application, data, and infra teams during major incidents.
- Prepared incident reports, post-mortems, and SLA compliance documentation.
- Used Azure Service Health to track regional outages and planned maintenance.
- Supported on-call rotations and ensured 24x7 monitoring coverage.
- Reduced incident resolution time (MTTR) by 30% using proactive alerts.
- Improved platform stability through continuous monitoring and RCA.
- Ensured 99.9% availability of data pipelines and cloud services.
Azure Data Engineer
HCL TECHNOLOGIES PVT LTD
11.2022 - 06.2023
- Designed and implemented automated ETL pipelines using Azure Data Factory (ADF) to ingest sales and master data from multiple sources into Azure Data Lake Storage Gen2 for analytics and reporting.
- Developed end-to-end ETL pipelines in Azure Data Factory for data ingestion from SQL Server and CSV files.
- Implemented full and incremental loads using watermark logic based on last modified date.
- Used ADF Copy Activity and Mapping Data Flows to cleanse, transform, and standardize data.
- Stored raw and processed data in ADLS Gen2 using optimized Parquet format.
- Parameterized pipelines and datasets to support dynamic source and target handling.
- Implemented error handling, logging, and retry mechanisms within ADF pipelines.
- Scheduled pipelines using ADF triggers and monitored executions via Azure Monitor.
- Secured credentials using Azure Key Vault and Managed Identity.
- Validated processed data for reporting using Power BI.
- Automated manual data loads, reducing operational effort by 35%.
- Improved data availability and reliability for business reporting.
- Built reusable and scalable ADF pipelines following best practices.
Azure Data Engineer
HCL TECHNOLOGIES
10.2022 - Current
- Developed a cloud-based data integration solution using Azure Data Factory (ADF) to ingest, transform, and load enterprise data into Snowflake Data Warehouse for analytics and reporting.
- Designed and developed ADF pipelines to extract data from Azure SQL Database and flat files.
- Implemented staging layer in ADLS Gen2 before loading data into Snowflake.
- Used Copy Activity to load data from ADLS Gen2 into Snowflake tables.
- Implemented incremental data loads using watermark columns and control tables.
- Created and managed Snowflake databases, schemas, and tables.
- Optimized Snowflake performance using warehouse sizing and clustering.
- Implemented role-based access control (RBAC) in Snowflake.
- Secured Snowflake credentials using Azure Key Vault.
- Automated pipelines using ADF triggers and monitored executions.
- Supported reporting and analytics using Power BI on Snowflake data.
- Reduced data load failures by implementing staging and retry mechanisms.
- Improved reporting performance by optimizing Snowflake warehouse usage.
- Delivered clean, analytics-ready data for business users.
Education
B.Tech - Electronics Communication Engineering
SVCET College of Engineering and Technology
01.2022
INTER(MPC) -
Narayana junior College
01.2018
SSC -
Good Shephered E.M High School
01.2016
Skills
- Azure Data factory
- Azure Data Lake
- Azure Blob Storage
- Azure Databricks
- Snowflake
- Microsoft SQL server
Certification
- AZ-900
- AZ-104
Personal Information
Title: Azure Data Engineer
Core Skills
Azure Data Factory, Azure Data Lake, Azure Blob Storage, Azure Databricks, Snowflake, Microsoft SQL Server, Azure Data Factory, SQL, PySpark
Timeline
Azure Data Engineer
HCL TECHNOLOGIES PVT LTD
11.2022 - 06.2023
Azure Cloud Support / Monitoring Engineer
HCL TECHNOLOGIES
10.2022 - Current
Azure Data Engineer
HCL TECHNOLOGIES
10.2022 - Current
B.Tech - Electronics Communication Engineering
SVCET College of Engineering and Technology
INTER(MPC) -
Narayana junior College
SSC -
Good Shephered E.M High School