Summary
Overview
Work History
Education
Skills
Timeline
Generic

SAI DILEEP AVALA

Samalkot

Summary

Results-driven Azure Data Engineer with strong skills in Azure Data Factory, Python, and SQL. Proven ability to optimize data pipelines and manage large-scale data operations to enhance business outcomes.

Overview

4
4
years of professional experience

Work History

Azure Data Engineer

Project 2: Walmart (Retail)
11.2022 - 06.2024
  • Managed continuous pipeline monitoring in ADF and implemented automated alerts using Azure Logic Apps for customized success/failure notifications.
  • Implemented CI/CD pipelines in Azure DevOps for deploying ADF pipelines and Databricks notebooks.
  • Developed and optimized data ingestion, transformation, and storage workflows across Azure Data Factory, Azure Databricks, and Azure SQL Database.
  • Built interactive data applications and REST APIs using Python (FastAPI, Streamlit) to support business operations.
  • Designed reusable data pipelines integrating structured/unstructured data into Azure Synapse Analytics.
  • Ensured performance optimization, code debugging, defect resolution, and rigorous unit testing for production stability.
  • Collaborated with cross-functional teams to handle large-scale retail data operations, ensuring scalability and compliance.

Azure Data Engineer

Project 1: Momenta (Pharmaceutical)
09.2021 - 10.2022
  • Monitored, troubleshot, and resolved failed pipelines in Azure Data Factory (ADF).
  • Designed and developed integrated datasets in Azure SQL using advanced SQL queries and stored procedures.
  • Performed data quality checks and handled null values during ETL processes in ADF.
  • Created and scheduled triggers in ADF to align with project requirements.
  • Supported deployment processes through Azure DevOps (CI/CD) for seamless migration to testing and production environments.
  • Built REST API-based data solutions using Python (FastAPI, Pandas, NumPy, JSON) integrated with Azure Data Lake and Blob Storage.
  • Implemented unit testing with pytest to ensure reliable and scalable code.
  • Contributed to ETL processes, moving data from multiple sources into Azure Synapse Analytics and Data Warehouses.

Junior Data Engineer

ACCENTURE
04.2020 - 08.2021
  • Monitoring the Pipeline and Job in ADF & Databricks.
  • Worked on Various File Formats like CSV, JSON, XML, Parquet, xlsx and sources like API, SharePoint, Web API etc.
  • Created multiple pipelines to copy data to different environments like ADLS, Synapse.
  • Used various Spark Transformations and Actions on Dataframe and Dataset for cleansing data.
  • Designed And Developed Data Ingestion Pipelines from On-Premise to Different Layers into The ADLS Using Azure Data Factory (Adf V2) Logic App Service to Send E-Mail Notification for Success & Failure of ADF Pipelines.

Education

BTECH -

Aditya Engineering College
Surampalem
06-2019

Skills

  • SQL
  • PySpark
  • Azure Databricks
  • Azure Datafactory
  • Azure Devops
  • Python
  • Azure Synapse
  • Power BI
  • Data Modelling
  • Data Integration
  • Data Warehousing
  • Data Cleansing
  • Data Transformation

Timeline

Azure Data Engineer

Project 2: Walmart (Retail)
11.2022 - 06.2024

Azure Data Engineer

Project 1: Momenta (Pharmaceutical)
09.2021 - 10.2022

Junior Data Engineer

ACCENTURE
04.2020 - 08.2021

BTECH -

Aditya Engineering College

Similar Profiles

CREATE PROFILE
SAI DILEEP AVALA