Summary
Overview
Work History
Education
Skills
Certification
Languages
Timeline
Generic

SAGAR BASUDE

HYDERABAD

Summary

  • Total overall 4 years of experience in the IT Industry with Strong working knowledge of Azure Data Factory, Azure Data bricks, SQL Server, Azure SQL Server and Microsoft
  • Hands-on experience in Azure Data factory and its Core Components like Linked Services, Datasets, Pipelines and Activities.
  • Worked on Get Metadata Activity, look up, Store Procedure, for each, IF and execute Pipeline activities
  • Implemented dynamic pipeline to extract Multiple files into Multiple targets with the help of a single pipeline
  • Extensively used ETL methodology for supporting Data Extraction, Transformation and processing of data from Sources like (SQL Server, AWSS3, FTP, Oracle, and Blob) using Azure Data Factory into Azure Data Lake Storage

Overview

6
6
years of professional experience
1
1
Certification

Work History

Cloud/Azure Data Engineer

TECH MAHINDRA LTD
Hyderabad
12.2023 - 04.2024
  • Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks.
  • Integrate Azure storage with Azure Databricks and build ELT pipeline using Databricks Jobs and Workflows.
  • Orchestrate Azure Databricks applications using ADF pipelines, and build Data pipelines using ADF pipelines and Databricks.
  • Deployed Pyspark applications and developed in the Databricks cluster
  • Recreated existing application logic and functionality in the Azure Data Factory, Azure SQL Database and Azure SQL Data Warehouse environment.
  • Performed evaluation of on-premises SQL database to Azure SQL.
  • Implemented Azure Data Factory operations and deployed into Azure for moving data from on-premise into the cloud.
  • Designed and implemented end-to-end data solutions (storage, integration, processing, visualization) in Azure.

Azure Data Engineer

AMAZON DEVELOPMENT CENTRE (INDIA) PRIVATE LIMITED
Hyderabad
07.2022 - 09.2022
  • Created dynamic pipelines to handle data extraction from multiple sources to multiple targets, extensively using Azure Key Vaults to configure connections in linked services.
  • Developed pipelines to extract data from on-premises source systems to Azure Cloud Data Lake Storage, utilizing copy activities and implementing various copy behaviours such as flattening hierarchy, preserving hierarchy, and merging hierarchy. Implemented robust error handling through copy activities.
  • Experienced with Azure Data Factory activities including Lookups, stored procedures, if conditions, for each loop, set variable, append variable, get metadata, filter, and wait activities.
  • Gained basic experience in Microsoft Power BI, Power BI Desktop, SQL Server, and DAX.
  • Proficient in gathering data from different sources like SQL Server and Excel for import into Power BI Desktop.
  • Skilled in performing various data transformations in Power BI, such as removing rows and columns, merging queries, appending queries, and creating custom and conditional columns.

Database Developer

AMAZON DEVELOPMENT CENTRE (INDIA) PRIVATE LIMITED
Hyderabad
09.2020 - 04.2022
  • Configured and implemented the Azure Data Factory Triggers and scheduled the Pipelines; monitored the scheduled Azure Data Factory pipelines and configured the alerts to get notification of failure pipelines.
  • Implemented delta logic extractions for various sources with the help of a control table; implemented the Data Frameworks to handle the deadlocks, recovery, and logging of the data of pipelines.
  • Reviewing individual work on ingesting data into Azure data lake and providing feedback based on reference architecture, naming conventions, guidelines and best practices
  • Involved in End-to-end logging frameworks for Data factory pipelines.
  • Extracted data from different sources such as Flat files, and Oracle to load into SQL database. Involved in the preparation and execution of the unit, integration and end-to-end test cases.
  • Writing the T-SQL Queries and Stored Procedures, User-Defined Functions, Views and Joins in an optimized way.
  • Maintaining the Incremental refresh and Full refresh scripts for loading data from Main DB to Stage DB.
  • Deploying the SQL Scripts into UAT and Production Environments.
  • Reviewing and Tuning SPs, User Defined Functions.

Jr. Data Engineer

Wipro Limited
Hyderabad
01.2019 - 03.2020
  • Led end-to-end data migration projects utilizing Azure Data Factory, successfully migrating and transforming data from various sources to Azure data platforms.
  • Designed and developed complex ETL pipelines in Azure Data Factory (ADF) to handle large volumes of data, ensuring data accuracy, consistency, and performance optimization.
  • Conducted thorough data source assessments and data profiling to identify data quality issues, implementing data cleansing and enrichment processes to enhance data reliability.
  • Implemented incremental data loading strategies, significantly reducing migration time by 30% and minimizing downtime, ensuring seamless transitions.
  • Created and maintained data integration workflows, orchestrations, and scheduling using Azure Data Factory pipelines and triggers, ensuring efficient and automated data movement.
  • Developed robust error handling mechanisms and monitoring solutions to proactively identify and resolve issues, maintaining high data integrity and reliability.
  • Achieved significant cost savings by optimizing Azure resource utilization, implementing cost-effective data storage solutions, and fine-tuning data processing methods.
  • Continuously monitored and improved ETL processes, leveraging feedback and new technologies to enhance performance and efficiency.

ETL Process Support Analyst

Conneqt Business Solutions
Hyderabad
03.2018 - 10.2018
  • Provided comprehensive monitoring and application support for business intelligence (ETL) tools, ensuring smooth operation and high availability.
  • Analyzed and resolved ETL job failure issues, offering timely and effective solutions to global Wells Fargo users and vendors.
  • Acted as the first point of contact, regularly updating the status of ETL jobs and reports, and communicating any issues through the appropriate channels.
  • Ensured all incidents, service requests, and work orders were resolved within SLA targets, maintaining a high level of service quality.
  • Diagnosed, prioritized, escalated, and followed up on issues, ensuring they were addressed promptly and effectively.
  • During crisis conditions, took on the role of problem facilitator, coordinating cross-functional team efforts to drive rapid issue resolution.
  • Maintained detailed documentation of incidents and resolutions, contributing to continuous improvement and knowledge sharing within the team.
  • Collaborated with other technical teams to enhance ETL processes and implement best practices for monitoring and support.
  • Proactively identified potential issues and implemented preventive measures to minimize disruptions.
  • Engaged in continuous learning and skill development to stay current with emerging ETL technologies and methodologies.

Education

Bachelor of Science -

Jagruti Institute of Engineering & Technology
Hyderabad,India
01-2018

Skills

  • ETL tools: Azure Data Bricks, Azure Data Factory
  • Azure storages: Azure Blob storage, Azure data lake gen 2
  • Databases: MS SQL Server 2014, 2016, SQL Azure, Pyspark, Azure SQL DB
  • Operating Systems: Windows
  • Languages: SQL, T SQL, Basics of Python
  • Reporting tool: Power BI

Certification

  • Azure: Microsoft Certified Azure Data Engineer DP-203
  • Udemy: Azure Data Factory for Data Engineers, Azure Databricks & Sparks For Data Engineers
  • Linkedin: Azure Data Lake for Developers, Azure Data Engineer Associate (DP-203)
  • W3Schools : Certified SQL Developer

Languages

Hindi
First Language
English
Proficient (C2)
C2
Hindi
Proficient (C2)
C2

Timeline

Cloud/Azure Data Engineer

TECH MAHINDRA LTD
12.2023 - 04.2024

Azure Data Engineer

AMAZON DEVELOPMENT CENTRE (INDIA) PRIVATE LIMITED
07.2022 - 09.2022

Database Developer

AMAZON DEVELOPMENT CENTRE (INDIA) PRIVATE LIMITED
09.2020 - 04.2022

Jr. Data Engineer

Wipro Limited
01.2019 - 03.2020

ETL Process Support Analyst

Conneqt Business Solutions
03.2018 - 10.2018

Bachelor of Science -

Jagruti Institute of Engineering & Technology

Similar Profiles

CREATE PROFILE
SAGAR BASUDE