Summary
Overview
Work History
Education
Skills
Personal Information
Certifications Courses
Accomplishments
Certification
Personal Interest
Timeline
Generic
SUNNY GUPTA

SUNNY GUPTA

Sr Data Engineer
Mumbai

Summary

Experienced IT consultant with over 14 years specializing in Data Engineering. Adept at designing DWH models, ETL, and reporting modules. Skilled in developing and deploying large-scale data marts, warehouses, and real-time/batch mode reporting solutions. Proficient in Cloud computing, Python, DW-BI, PL/SQL, Data Strategy, and Solution offering. Senior engineering professional excelling in data architecture, pipeline development, and big data technologies. Proven track record of optimizing workflows and driving business intelligence initiatives through teamwork and innovation. Proficient in SQL, Python, Spark, and cloud platforms. Strategic approach to data management and problem-solving.

Overview

12
12
years of professional experience
4
4
years of post-secondary education
1
1
Certification
2
2
Languages

Work History

Senior Data Engineer (AWS Stack and Snowflake)

TIAA
01.2021 - Current
  • Led the migration of more than 15 different source systems from Different on-Prem solutions to AWS cloud.
  • Created end-to-end enterprise data lake with downstream warehouse and data marts for different business needs.
  • Involved in Data Modeling, Architect & Governance of data infrastructure.
  • Using a list of tools such as Python, AWS Glue, and Snowflake to solve data engineering problems.
  • Cloud/On-Premises database, synchronization using Data Migration Service (Data Sync).
  • Hands-on on building complex query logic to suit ad-hoc and scheduled reporting needs.
  • Involved in Snowflake Architecture in terms of Pricing, compute and Storage.
  • Used Data Migration Service(DMS) to lift and shift data from Oracle to Snowflake.
  • Involved in snowflake roles creation pertaining to Different environments.
  • Define the strategies for data migration / integration and plan the impact and gap analysis.
  • Lift and shift existing oracle data to snowflake using DMS.
  • Creation of Snow Pipe for continuous data flows with Amazon S3 using integration object and IAM.
  • Developed Autosys Jobs to orchestrate the end to end flow.
  • Build Data Architecture, conceptual and logical data models for cloud DW / Data Marts.
  • Create Business glossary and Governance catalog and Data lineage from metadata.
  • Replicate Oracle Connectors with Snowflake in Datastage jobs and rewritten stored procedures in python to enforce constraints prior data loads.
  • Created a Data Movement Control Framework to capture the exception in the data.
  • Code Repository management and Code deployment to higher environment through Git Pipelines.
  • Involved in performance tuning and optimization.

Data Engineer (MS Azure Stack)

TIAA
01.2017 - 12.2021
  • Led the migration of more than 25 different source systems from Different on-prem solutions to Azure cloud.
  • Created end-to-end enterprise data lake with downstream warehouse and data marts for different business needs.
  • Involved in Data Modelling, Architect & Governance of NBFC data infrastructure.
  • Designing DQMF (data quality monitoring framework).
  • Architect solutions using Azure IaaS and PaaS service.
  • Using a list of tools such as Python, ADF, Databricks, and Synapse analytics to solve data engineering problems.
  • Leading the whole Azure environment setup.
  • Cloud/On-Premises database, synchronization (Data Sync).
  • Distributed compute solution (Spark, data bricks).
  • Hands-on on building complex query logic to suit ad-hoc and scheduled reporting needs.
  • Used Talend and ADF to design end-to-end ETL and Orchestration design on Azure.
  • Talend and Azure Data Catalog & Data quality.
  • Used Azure Synapse analytics for data processing and transformation.

ETL Lead

Cognizant Technology Solutions
04.2016 - 03.2017
  • Interacting with Data Analyst, Business Analyst to identify and freeze requirements and mappings to develop the ETL solution.
  • Develop scripts to validate source files.
  • Creating Control m jobs to run batches.
  • Code Repository management and Code deployment to higher environment through GitLab and serena.
  • Developed an ETL solution to load the data from different sources in Oracle using Datastage.

ETL Developer

HSBC
06.2013 - 03.2016
  • Interacting with Data Analyst, Business Analyst to identify and freeze requirements and mappings to develop the ETL solution.
  • Develop scripts to validate source files.
  • Creating Control m jobs to run batches.
  • Code Repository management and Code deployment to higher environment through GitLab and Serena.
  • Developed an ETL solution to load the data from different sources in Oracle using Datastage.

Education

Bachelor of Technology - Information Technology

Institute of Engineering And Technology (IET)
Lucknow
01.2006 - 01.2010

Skills

Personal Information

Date of Birth: 01/29/87

Certifications Courses

  • Python Certification Zero to Mastery from Udemy.
  • AZ-900.
  • Snowflake course from Udemy.

Accomplishments

  • Winner of Table Tennis in Intra corporate tournament 2023 and 2024.
  • Active Member of Interview Panel
  • Active member of Committee that organizes cultural and Sports events
  • Employee of the Quarter in 2018.
  • Captain of College Cricket team 2007-2010 and Player of the tournament 2009.
  • Runner-up in Singing at Wipro event-AARAMBH
  • Runner up in Badminton tournament organized in TIAA 2019

Certification

AZ900

Personal Interest

I like to play multiple sports like Tennis, Table Tennis, Squash and Cricket. 

Timeline

AZ900

10-2023

Senior Data Engineer (AWS Stack and Snowflake)

TIAA
01.2021 - Current

Data Engineer (MS Azure Stack)

TIAA
01.2017 - 12.2021

ETL Lead

Cognizant Technology Solutions
04.2016 - 03.2017

ETL Developer

HSBC
06.2013 - 03.2016

Bachelor of Technology - Information Technology

Institute of Engineering And Technology (IET)
01.2006 - 01.2010

Similar Profiles

CREATE PROFILE
SUNNY GUPTASr Data Engineer