Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

Gadidala Prasad

Azure Data Engineer
Bengaluru

Summary

Dynamic and results-driven Azure Data Engineer with over 10 years of experience in Information Technology, including 4+ years specializing in Azure data solutions. Expertise encompasses a wide range of Azure services such as SQL Server, Data Factory, Data Lake Storage, Synapse Analytics, and Databricks. Proven track record of implementing efficient ETL methodologies for data extraction, transformation, and processing. Proficient in creating and managing complex ADF pipelines that connect to diverse data sources and handling administrative tasks related to access management and network configurations. Strong analytical skills combined with hands-on experience in RDBMS and data warehousing concepts ensure the delivery of high-quality data solutions tailored to meet organizational needs.

Overview

10
10
years of professional experience
2
2
Certifications

Work History

Azure Data Engineer at Tata Consultancy Services

Rabobank NL
Bengaluru
10.2021 - Current
  • Extracted the data from on-premises source systems, transformed, cleansed, validated, and loaded it into destinations.
  • Created the pipeline, extracting data from different sources, and loading the data into Azure Data Lake Storage Gen 2.
  • Extracted the data from ADLS Gen 2, transformed it, and loaded the data into Azure SQL DB.
  • Created the Linked Services for various source systems and target destinations.
  • Created the datasets for various source systems and target destinations.
  • Parameterized the datasets and linked services using the parameters and variables.
  • Implemented the optimization techniques and best practices in Azure Data Factory and Azure Data bricks notebooks.
  • Created the release pipelines to deploy the code from dev to prod using Azure Release Pipelines.
  • Used the For Each Loop Activity for iterating through the multiple loads, as per the business requirement.
  • Developed SQL queries to validate the data, such as checking for duplicates, null values, truncated values, and ensuring correct data aggregations.
  • Implementing slowly changing dimensions to maintain historical data in required dimension tables.
  • Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.

Senior Software Engineer at Softtek India Pvt LTD

Southwest Airlines,USA
Bengaluru
06.2016 - 09.2021
  • Providing L2 support for Business Application servers and Databases. worked on Azure SQL DB and ADF support.
  • Involving in troubleshooting, analyzing, and resolving day to day incidents and requests on Production, Dev, and QA servers. Handling multiple Change requests for various applications during non-business hours.
  • Troubleshooting Application performance issues, storage issues and user connectivity issues.
  • Troubleshooting Data error issues and other business-related incidents.
  • Enhanced ETL processes by optimizing complex SQL queries and streamlining data extraction procedures.
  • Implemented proactive monitoring solutions for ETL processes, identifying potential bottlenecks before they impacted users.
  • Conducted knowledge transition & shadow support for the newly joined team members.
  • Handling the user issues and assisting the team in technical issues.
  • Reduced processing time for ETL tasks through the implementation of parallel execution strategies.
  • Managed data quality issues during ETL processes, directing qualitative failures to team lead for amelioration.

Software Consultant at MBIT Computers Pvt Ltd

Allianz Life Insurance Company of North America
Bengaluru
05.2015 - 05.2016
  • Extracted data from various heterogeneous sources, like Oracle and flat files.
  • Extensively worked with Slowly Changing Dimensions Type 1 and Type 2 for data loads.
  • Responsible for performance tuning at the mapping, session, and target level.
  • Created workflows with the event wait task to specify when the workflow should load the tables.
  • Expertise with both connected and unconnected lookups, reusable transformation, and extensive work with lookup caches like shared cache, persistent cache, static cache, and dynamic cache to improve the performance of the lookup transformations; extensively used SQL override function in source qualifier transformation.
  • I worked extensively with incremental loading using parameter files, mapping variables, and mapping parameters.
  • Implemented pipeline partitioning concepts, such as round robin, key-range, and pass-through techniques, in mapping transformations.
  • Created and dropped the indexes to load data efficiently, and decrease load time.

Education

B. Tech - Electrical and Electronics Engineering

JNTU HYD University
Hyderabad

Skills

Proficient in Azure cloud services

  • Azure Datafactory

  • Experience with Azure Databricks

Azure Blob and Data Lake storage

  • Azure Synapse Analytics

  • Azure DevOps CI/CD

  • Azure Data Lake

ETL development

Data pipeline design

Data modeling

Data warehousing

Data governance

Data integration

Certification

Microsoft Azure Fundamentals (AZ-900)

Timeline

Azure Data Engineer at Tata Consultancy Services

Rabobank NL
10.2021 - Current

Senior Software Engineer at Softtek India Pvt LTD

Southwest Airlines,USA
06.2016 - 09.2021

Software Consultant at MBIT Computers Pvt Ltd

Allianz Life Insurance Company of North America
05.2015 - 05.2016

B. Tech - Electrical and Electronics Engineering

JNTU HYD University

Similar Profiles

CREATE PROFILE
Gadidala PrasadAzure Data Engineer