Lakshmi Devarapalli
Summary
Results-driven Azure Data Engineer with expertise in designing ETL pipelines and data transformations at IN TECHNET LIMITED. Proficient in Azure Data Factory and PySpark, I excel in optimizing data processes and collaborating with analytics teams to enhance data quality. Committed to delivering impactful solutions and driving operational efficiency.
Overview
4
4
years of professional experience
Work History
Azure Data Engineer
IN TECHNET LIMITED
11.2024 - Current
- Designed and developed end-to-end ETL pipelines using Azure Data Factory for structured enterprise data.
- Migrated data from on-premises and legacy systems into Azure Data Lake Storage Gen2.
- Implemented data transformations using PySpark and Spark SQL in Azure Databricks.
- Converted existing SQL, T-SQL, and ETL logic into Spark DataFrames and Spark SQL queries.
- Developed parameterized datasets and pipelines to enable reusable and dynamic data processing.
- Implemented incremental, snapshot, and full-load processing strategies.
- Created and maintained curated data layers for downstream analytics and reporting.
- Validated data quality, performed root cause analysis, and resolved pipeline failures.
- Scheduled and automated pipeline executions using ADF triggers.
- Supported deployment, monitoring, and post-production issues.
- Project: Yara
- Role: Azure Data Engineer | Experience: 1 Year
Azure Support / Data Operations Engineer
IN TECHNET LIMITED
02.2023 - 11.2024
- Provided L2 support for Azure-based data and infrastructure workloads.
- Monitored and supported daily execution of Azure Data Factory pipelines.
- Assisted data engineering teams during data load failures and performance issues.
- Managed Azure VMs including provisioning, disk expansion, patching, and troubleshooting.
- Worked with Azure Storage services such as Blob Storage and File Shares.
- Supported VNet and VNet peering configurations.
- Monitored systems using Zabbix and participated in incident resolution.
- Project: Super Value
- Role: Azure Support / Data Operations Engineer
Azure Admin
Capgemini
12.2022 - 02.2023
- Installed, configured, and administered Windows servers in Azure.
- Supported cloud infrastructure operations and monitoring.
- Assisted with storage, networking, and access-related tasks.
Azure Admin
Sure Minds India Private Limited
07.2022 - 12.2022
- Installed, configured, and administered Windows servers in Azure.
- Supported cloud infrastructure operations and monitoring.
- Assisted with storage, networking, and access-related tasks.
Education
Bachelor of Technology - ECE
WISE Engineering College
TadepalligudemBachelor of Technology -
Jawaharlal Nehru Technological University
KakinadaSkills
- Data ingestion and orchestration with Azure Data Factory
- Data transformation and processing using PySpark
- Data modeling and layered architecture
- Incremental and snapshot loading strategies
- Performance tuning of ADF pipelines
- Debugging and monitoring of data pipelines
- Delta Lake concepts knowledge
- Collaboration with analytics teams
- Azure Data Factory expertise
- Azure Databricks proficiency
- Azure Data Lake Storage Gen2 experience
- Azure SQL Database skills
- SQL proficiency
- Spark SQL expertise
- Microsoft SQL Server knowledge
- Oracle database skills
Timeline
Azure Data Engineer
IN TECHNET LIMITED
11.2024 - Current
Azure Support / Data Operations Engineer
IN TECHNET LIMITED
02.2023 - 11.2024
Azure Admin
Capgemini
12.2022 - 02.2023
Azure Admin
Sure Minds India Private Limited
07.2022 - 12.2022
Bachelor of Technology - ECE
WISE Engineering College
Bachelor of Technology -
Jawaharlal Nehru Technological University