Accomplished Data Engineer with more than 6 years of related experience. Expert in translating complex business logics into efficient data solutions, demonstrating exceptional analytical and problem-solving skills.
Overview
6
6
years of professional experience
1
1
Certification
Work History
Data Engineer
Accenture - Toyota Motor Handling North America
Kolkata
09.2021 - Current
As a Data Engineer, I developed several Azure Data Factory pipelines to ingest data from different on-premises and cloud-hosted sources, such as SAP ECC, SAP CRM, SQP BW, Blob Storage, Data Lake, SQL Server, etc. and supplied the transformed data to Cosmos DB to be invoked by different teams, i.e., the EIL Team, the Portal Team, and analysts.
Designed and implemented several business logics using Spark SQL and PySpark in Databricks.
Created Databricks notebooks to load the data into different layers, like Raw, Processed, and Refined.
Created various Databricks notebooks to generate the JSON structure to load the data into Cosmos DB.
ETL Developer
TCS - Hallmark Cards
Kolkata
09.2018 - 08.2022
Developed several Azure Data Factory pipelines to ingest data from different sources, such as SQL Server, Blob Storage, and SAP, and supplied the transformed data to be invoked by different teams, i.e., Finance, B2B, Data Science Team, etc.
Migrated several DataStage job logics into ADF pipelines to extract data from different sources hosted in the cloud, and implemented the transformation logics to load data in ADLS.
As an ETL developer, I designed and productionized several Datastage job logics to extract and load transformed data into different databases, and I prepared data for data warehouses after implementing SCDs (Type 1, 2, 3).
Education
Bachelor of Technology - Electrical Engineering
Academy of Technology, Maulana Abul Kalam Azad University of Technology
West Bengal
01.2018
Higher Secondary Examination -
Ramnagar NBPC High School
West Bengal
01.2014
Secondary Examination -
Ramnagar NBPC High School
West Bengal
01.2012
Skills
Azure Data Factory
Azure SQL Server
Azure Datalake Storage Gen2
Azure Blob Storage
Databricks
Spark SQL
Data Flow
Datastage
Unix
Teradata
Certification
Azure Data Engineer Associate - DP203, Microsoft
Azure Fundamentals - AZ900, Microsoft
Azure Data Fundamentals - DP900, Microsoft
Data Warehouse Fundamentals, Udemy
Hobbies and Interests
Animation
Rubik's Cube
Puzzle Solving
Languages
English, Full Professional Proficiency
Hindi, Full Professional Proficiency
Bengali, Native or Bilingual Proficiency
Timeline
Data Engineer
Accenture - Toyota Motor Handling North America
09.2021 - Current
ETL Developer
TCS - Hallmark Cards
09.2018 - 08.2022
Azure Data Engineer Associate - DP203, Microsoft
Azure Fundamentals - AZ900, Microsoft
Azure Data Fundamentals - DP900, Microsoft
Data Warehouse Fundamentals, Udemy
Bachelor of Technology - Electrical Engineering
Academy of Technology, Maulana Abul Kalam Azad University of Technology
Higher Secondary Examination -
Ramnagar NBPC High School
Secondary Examination -
Ramnagar NBPC High School
Similar Profiles
Bradley FaulknerBradley Faulkner
District Manager at Toyota Motor North America (Central Atlantic Toyota)District Manager at Toyota Motor North America (Central Atlantic Toyota)