AKASHDEEP Chowdhury
Azure Data Engineer
KOLKATA
Summary
- Experience working with relational databases like Oracle and Microsoft SQL Server.
- Extensive exposure to various Azure services such as Azure Data Factory (ADF), Azure Databricks (ADB), Azure Synapse, and Azure Data Lake Storage (ADLS), with hands-on experience in implementing data solutions using these services.
- Experience in designing and developing end-to-end ETL pipelines utilizing ADF/Synapse connecting various endpoints including ADLS, Azure SQL, Salesforce, EDH, NAS, Oracle, MS SQL, etc
- Designing, developing, and maintaining Databricks notebooks using PySpark and Spark SQL to perform data validation, data cleansing, and data transformations
- Exposure to enterprise-grade Datawarehouse based on dimensional modeling.
- Experienced in migrating enterprise-grade analytics applications from Oracle to Azure Cloud, ensuring minimal downtime and data loss.
- Managed the seamless integration of extensive incoming datasets by proficiently executing ETL processes, ensuring the efficient loading of data into the Data Warehouse to support robust reporting and analytics functionalities.
- Comprehensive understanding of the Software Development Life Cycle (SDLC), actively participating in all stages from requirements gathering to deployment and maintenance, ensuring adherence to best practices and standards.
Overview
3
3
years of professional experience
4
4
years of post-secondary education
1
1
Certification
Work History
Azure Data Engineer
Tata Consultancy Services Ltd.
Kolkata
08.2021 - Current
- Working in the Data Foundations team responsible for designing, developing, and maintaining Azure Cloud data infrastructures to load data from various on-prem systems to Azure Cloud Platform and prepare it for downstream processing
- Utilized Azure Synapse Analytics Service to create logical data warehouses on top of various file formats in ADLS ingested from on-premises systems
- Implemented end-to-end pipeline to ingest parsed XML data from on-premises SQL Server, perform transformations, and load the final dataset to Salesforce
- Designed and implemented a comprehensive pipeline for ingesting parsed XML data from on-premises SQL Server and loading the data as parquet files in ADLS
- Utilized Azure Synapse Serverless SQL pool to create an External Table on top of ingested data stored in the ADLS landing zone
- Designed and implemented dataflow in the Synapse pipeline to perform transformations on landing zone data and load the transformed dataset to Salesforce.
Education
Btech In Electrical Engineering -
Maulana Abul Kalam Azad University
Kolkata 08.2016 - 05.2020
Skills
Azure Data Factory (ADF)
Azure Databricks (ADB)
Azure Synapse Analytics
Azure Data lake Storage (ADLS)
PySpark/Spark SQL
Data Warehousing
ETL
Data warehousing
Data modeling
Introduction
Seasoned Data Engineer at Tata Consultancy Services with over 4 years of experience in successfully executing end-to-end data integration projects within the banking and insurance domain, utilizing Azure Cloud Infrastructure.
Certification
DP 203: Microsoft Certified Azure Data Engineering, Microsoft, 12/2024, Present
Timeline
DP 203: Microsoft Certified Azure Data Engineering, Microsoft, 12/2024, Present
12-2024
Azure Data Engineer
Tata Consultancy Services Ltd.
08.2021 - Current
Btech In Electrical Engineering -
Maulana Abul Kalam Azad University
08.2016 - 05.2020