Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

GANESH SATTI

Hyderabad

Summary

Experienced Azure Data Engineer with 5+ years of experience in designing, implementing, and managing data solutions on Microsoft Azure. Seeking Senior/Data Engineer position specializing in Azure Data Factory (ADF), Azure Databricks (ADB), Spark, Pyspark, Spark SQL, and Azure Data Lake Storage. Proven track record of delivering scalable and efficient data solutions that meet business objectives. Strong expertise in data integration, ETL processes, and data warehousing. Collaborative team player skilled at analyzing requirements and developing innovative solutions to optimize data processing and analysis.

Overview

7
7
years of professional experience
1
1
Certification

Work History

Data Engineer

LTIMindtree/CopperPoint
06.2022 - Current
  • Designed & Built Azure Data Factory pipelines to ingest the data into Azure Data Lake Storage from SQL Server
  • Developed Spark applications using Pyspark and Spark-SQL for data extraction, transformation and aggregation from multiple file formats for analyzing and transforming the data to uncover insights into the customer usage patterns
  • Hands on experience in Azure data factory like creating Pipelines, scheduling triggers and managing the dataflow
  • Ingesting and transforming the raw data by using Azure data factory
  • Developed Databricks notebooks to read the ingested data from Azure Data Lake Storage and perform ETL transformations and load into delta table
  • Written Pyspark code in notebooks in data bricks for data cleaning and Performed Unit testing and collaborated with QA team
  • Developing Spark notebooks to transform and partition the data and organize files in Azure Data Lake Storage.

Data Engineer

TEKsystems Global Services/FHB
12.2020 - 06.2022
  • Create and maintain optimal data pipeline architecture using Data Factory and Azure Databricks
  • Frequently coordinating with Business team regarding the change requests and functionality
  • Extract, transform ad load from source systems to Azure Data storage services using a combination of Azure
  • Data Factory, Spark SQL
  • Involved in writing Pyspark scripts for data processing as per business requirements
  • Worked independently by ingesting the data into Azure Data Lake and provided the feedbacks based on reference architecture.

Data Engineer

Cognizant/BCG
07.2019 - 11.2020
  • Involved in complete Software Development Life Cycle (SDLC) process by analyzing business requirements and understating the functional workflow of information from source systems to destination systems
  • Experience in developing Spark Applications using Spark SQL and Pyspark in Databricks from multiple file formats for analyzing & transforming the data
  • Deployed Azure Data Factory for creating pipeline to orchestrate the data in SQL Database
  • Involved in migrating activity, migrating data from On-Prem to Cloud
  • Attending daily scrum calls to give update on the work.

Analyst

W3Global
12.2017 - 06.2019

Education

Bachelors in computer science -

BVC Engineering College

Skills

  • Azure Data Factory (ADF)
  • Azure Databricks (ADB)
  • Pyspark
  • Spark SQL
  • Azure Data Lake Storage
  • Big Data Processing
  • Data Warehousing
  • Data Pipeline Design
  • Agile

Certification

  • DP-203: Azure Data Engineer Associate
  • DP-900: Azure Data Fundamentals
  • AZ-900: Azure Fundamentals
  • PSM I: Professional Scrum Master

Timeline

Data Engineer

LTIMindtree/CopperPoint
06.2022 - Current

Data Engineer

TEKsystems Global Services/FHB
12.2020 - 06.2022

Data Engineer

Cognizant/BCG
07.2019 - 11.2020

Analyst

W3Global
12.2017 - 06.2019

Bachelors in computer science -

BVC Engineering College

Similar Profiles

CREATE PROFILE
GANESH SATTI