Summary
Overview
Work History
Education
Skills
Timeline
Generic

Vemula Dilip

Azure Data Engineer | ETL Developer
Hyderabad,Telangana

Summary

I have 4+ Years of Experience on migrating SQL database to Azure data lakes, Analytics, Azure SQL database, Data bricks and Azure SQL Data warehouse and controlling and granting database access and migrating on premise database to Azure data lake store using Azure data factory . Experienced Data Engineer and ETL Developer with expertise in design and implementation of Data Solutions for Data Warehousing and Analytics.

Overview

6
6
years of professional experience
4
4
years of post-secondary education

Work History

Data Engineer

Tsarolabs
Hyderabad
6 2023 - Current
  • Designed End-to-End Pipeline to Pull the records from Database/File and sending it back to Client
  • Performing Data Validation on files using Mapping Data Flow activities like Conditional Splits, Derived Column, Aggregate
  • Creating Azure Function using Python and Integrating in Azure Data Factory pipelines
  • Integrated pipeline with Logic Apps, Custom Activity
  • Performing POC to do ETL Operation on bulk data in Databricks using PySpark
  • Performance tuning of SQL Queries on Azure Synapse.

Data Engineer

Photon
Bangalore
02.2022 - 02.2023
  • Created Pipelines in ADF using Linked Services, Datasets, Pipeline to Extract, Transform and load data from different,Sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards, Hands on Experience of Data Bricks using PySpark for data extraction, transformation, and aggregation from multiple file formats for analysing & transforming the data,Designing workflow in Azure Logic Apps,Planning to integrate Azure Services to Analytic Platform like Azure Analytics and generating Reports
  • Designing Azure Data factory Pipelines to pull record from Azure Synapse and loading the data to ADLS
  • Performing Unit Test on the code Designed
  • Gathering Requirement from Client and designing the job
  • Analyzing the jobs and optimizing it in order to executethe flow faster
  • Involved with Tier2/Tier1 teams to solve the production failure and in creation of Restart.
  • Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability

Data Engineer

Grasp Technologies
Pun, Maharashtra
01.2019 - 02.2022
  • Client Interaction, requirement gathering, requirement analysis and preparing Application Design documents
  • Developing ETL job flows for pulling data from Files and performing transformation based on the requirement
  • Analyzing the job flow and optimizing it in best possible way in order to get the data more efficiently
  • Developed Automated Script using Shell scripting that will reduce the manual efforts needed in creating folders in Dev, Test and Prod Env, data filtering

Education

B.Tech - Information Technology

Jawaharlal Nehru Technological University Hyderabad
Karimnagar
03.2010 - 05.2014

Skills

AZURE DATA FACTORY

AZURE DATALAKE STORAGE

AZURE SQL SERVER

AZURE DATABRICKS

AZURE BLOB STORAGE

AZURE FUNCTION & LOGIC APPS

AZURE CI/CD WITH AZURE DEVOPS

PYTHON PROGRAMMING

PYSPARK

POWER BI

Timeline

Data Engineer

Photon
02.2022 - 02.2023

Data Engineer

Grasp Technologies
01.2019 - 02.2022

B.Tech - Information Technology

Jawaharlal Nehru Technological University Hyderabad
03.2010 - 05.2014

Data Engineer

Tsarolabs
6 2023 - Current

Similar Profiles

CREATE PROFILE
Vemula DilipAzure Data Engineer | ETL Developer