Summary
Overview
Work History
Education
Skills
Languages
Timeline
Generic

Dilip Vemula

Azure data engineer
Hyderabad,TG

Summary

I have 6 years of experience in IT, with 4.5 years of relevant experience as a Data Engineer, specializing in ETL development and data pipeline design at Cognizant. Proficient in Azure Data Factory and SQL, I excel in optimizing data systems and ensuring data integrity. A collaborative problem-solver, I have successfully automated data quality checks, enhancing operational efficiency.

Overview

6
6
years of professional experience

Work History

Data Engineer

Cognizant
Hyderabad
12.2024 - Current
  • Analyzed user requirements, designed and developed ETL processes to load enterprise data into the Data Warehouse.
  • Developed and implemented data models, database designs, data access and table maintenance codes.
  • Optimized existing queries to improve query performance by creating indexes on tables.
  • Developed Python scripts for extracting data from web services API's and loading into databases.
  • Monitored data systems performance, identifying bottlenecks and implementing solutions to maintain system efficiency.
  • Automated data quality checks and error handling processes to ensure the integrity and reliability of datasets.

Data Engineer

Tsarolabs
Hyderabad
05.2023 - 07.2024
  • Designed End-to-End Pipeline to Pull the records from Database/File and sending it back to Client
  • Performing Data Validation on files using Mapping Data Flow activities like Conditional Splits, Derived Column, Aggregate
  • Creating Azure Function using Python and Integrating in Azure Data Factory pipelines
  • Integrated pipeline with Logic Apps, Custom Activity
  • Performing POC to do ETL Operation on bulk data in Databricks using PySpark
  • Performance tuning of SQL Queries on Azure Synapse.

Data Engineer

Photon
Bengaluru
02.2022 - 02.2023
  • Created Pipelines in ADF using Linked Services, Datasets, Pipeline to Extract, Transform and load data from different, Sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards
  • Hands on Experience of Data Bricks using PySpark for data extraction, transformation, and aggregation from multiple file formats for analysing & transforming the data
  • Designing workflow in Azure Logic Apps
  • Planning to integrate Azure Services to Analytic Platform like Azure Analytics and generating Reports
  • Designing Azure Data factory Pipelines to pull record from Azure Synapse and loading the data to ADLS
  • Performing Unit Test on the code Designed

Software Engineer

Datapro Technology Pvt Ltd
Pune
01.2019 - 01.2022
  • Tested cross-browser compatibility for websites and applications in Chrome, Firefox, Safari, Opera and Internet Explorer.
  • Worked closely with designers to implement UI and UX designs accurately in the codebase.
  • Used Firebug or Chrome Developer to troubleshoot codes.
  • Developed web applications using HTML, CSS, JavaScript and JQuery.
  • Optimized websites for maximum speed and scalability.
  • Collaborated with other developers on coding projects.

Education

Bachelor of Science - Information Technology

Jawaharlal Nehru Technological University Hyderaba
Karimnagar

Skills

  • Azure Data Factory
  • Data integration
  • ETL development
  • Data pipeline design
  • Data migration
  • Data governance
  • SQL and databases
  • Data bricks

Languages

English
First Language
English
Advanced (C1)
C1
Hindi
Proficient (C2)
C2
Telugu
Advanced (C1)
C1

Timeline

Data Engineer

Cognizant
12.2024 - Current

Data Engineer

Tsarolabs
05.2023 - 07.2024

Data Engineer

Photon
02.2022 - 02.2023

Software Engineer

Datapro Technology Pvt Ltd
01.2019 - 01.2022

Bachelor of Science - Information Technology

Jawaharlal Nehru Technological University Hyderaba

Similar Profiles

CREATE PROFILE
Dilip Vemula Azure data engineer