Sagnik Gupta
Data Engineer
Kolkata
Summary
Total Experience of 3 years in data engineering.extensive hands on experience in creating pipelines using Azure Data Factory,Data Bricks , Azure Blob Storage , Data Lake and Azure SQL DB.Done considerable development using Python,Pyspark and SQL. Along with Data Engineering also worked as a developer in Microsoft SQL Server
Overview
3
3
years of professional experience
17
17
years of post-secondary education
2
2
Certifications
Work History
Data Engineer
Cognizant Technology Solutions
Kolkata
09.2021 - Current
- Responsible to gather requirement and creating High Level and Low level technical design documents
- Responsible to create an automated Data Ingestion Framework using Azure Synapse Integration for copying Transactional and Master tables from different SAP sources
- Responsible or creating Cleaning Layers to apply transformations to the incoming tables dynamically using Notebooks,Stored Procedures and SQL Functions
- Responsible to create delta lake based on Partitions to expose the data in serverless pools for Use Case Teams
- Responsible to Orchestrate all over pipelines and run it in a schedule
- Responsible to input configurations to configuration tables
- Responsible for Data Validation
- Responsible to for attending sessions for improvisations
- Responsible for attending to any bugs, code manipulations
Associate Consultant
Wipro Technologies
Bhubaneswar
05.2019 - 08.2021
- Was responsible for responding to issues,bug changes and code implementations
- Was responsible for inserting Data with help of Microsoft CRM
- Was responsible to run Spark SQL for implementing Data Quality Checks
- Was responsible to Create/Update/Configure various Entries in Production Support Application
- Was responsible to convert CSV file to spark Dataframe and transform and analyze Data as per Business Needs
Education
Bachelor of Technology - Electrical, Electronics And Communications Engineering
University Of Engineering And Management , Kolkata
Kolkata 04.2015 - 04.2019
Higher Secondary - Science
Satyanarayan Academy
Bankura 05.2013 - 04.2015
Matriculation - Science
Assembly Of God Church School
Asansol 04.2002 - 04.2013
Skills
Have experience in designing and developing ETL pipelines using Azure Factory and Azure Synapse Analytics
Worked on Data Extraction , Transforming and loading from different sources to different targets
Well versed in relational and Data Warehousing environments
Good Interpersonal and Communication skills ,commitment and result oriented and zeal to learn new technologies and undertake challenging tasks
Accomplishments
- State Topper in Mathematics Olympiad in Secondary Education
- Earned National Recognition in Tabla Playing in the year 2005 and received honorary award by Padmabhusan Manna Dey
Certification
Azure Data Engineer Associate
Hobbies
- Playing Tabla , Drums
- Playing FPS Games
- Travelling
- Listening to Music
https://www.linkedin.com/in/sagnik-gupta-017710171/
Timeline
Azure Data Engineer Associate
07-2022
Azure Fundamentals
05-2022
Data Engineer
Cognizant Technology Solutions
09.2021 - Current
Associate Consultant
Wipro Technologies
05.2019 - 08.2021
Bachelor of Technology - Electrical, Electronics And Communications Engineering
University Of Engineering And Management , Kolkata
04.2015 - 04.2019
Higher Secondary - Science
Satyanarayan Academy
05.2013 - 04.2015
Matriculation - Science
Assembly Of God Church School
04.2002 - 04.2013