AKASHDEEP Chowdhury
Azure Data Engineer
KOLKATA
Summary
- Experience working with relational databases like Oracle and Microsoft SQL Server.
- Extensive exposure to various Azure services such as Azure Data Factory (ADF), Azure Databricks (ADB), Azure Synapse, and Azure Data Lake Storage (ADLS), with hands-on experience in implementing data solutions using these services.
- Experience in designing and developing end-to-end ETL pipelines utilizing ADF/Synapse connecting various endpoints including ADLS, Azure SQL, Salesforce, EDH, NAS, Oracle, MS SQL, etc
- Designing, developing, and maintaining Databricks notebooks using PySpark and Spark SQL to perform data validation, data cleansing, and data transformations
- Exposure to enterprise-grade Datawarehouse based on dimensional modeling.
- Experienced in migrating enterprise-grade analytics applications from Oracle to Azure Cloud, ensuring minimal downtime and data loss.
- Managed the seamless integration of extensive incoming datasets by proficiently executing ETL processes, ensuring the efficient loading of data into the Data Warehouse to support robust reporting and analytics functionalities.
- Comprehensive understanding of the Software Development Life Cycle (SDLC), actively participating in all stages from requirements gathering to deployment and maintenance, ensuring adherence to best practices and standards.
Overview
3
3
years of professional experience
4
4
years of post-secondary education
1
1
Certification
Work History
Azure Data Engineer
Tata Consultancy Services Ltd.
Kolkata
08.2021 - Current
- Working in the Data Foundations team responsible for designing, developing, and maintaining Azure Cloud data infrastructures to load data from various on-prem systems to Azure Cloud Platform and prepare it for downstream processing
- Utilized Azure Synapse Analytics Service to create logical data warehouses on top of various file formats in ADLS ingested from on-premises systems
- Implemented end-to-end pipeline to ingest parsed XML data from on-premises SQL Server, perform transformations, and load the final dataset to Salesforce
- Designed and implemented a comprehensive pipeline for ingesting parsed XML data from on-premises SQL Server and loading the data as parquet files in ADLS
- Utilized Azure Synapse Serverless SQL pool to create an External Table on top of ingested data stored in the ADLS landing zone
- Designed and implemented dataflow in the Synapse pipeline to perform transformations on landing zone data and load the transformed dataset to Salesforce.
Education
Btech In Electrical Engineering -
Maulana Abul Kalam Azad University
Kolkata 08.2016 - 05.2020
Skills
Azure Data Factory (ADF)
undefinedIntroduction
Seasoned Data Engineer at Tata Consultancy Services with over 4 years of experience in successfully executing end-to-end data integration projects within the banking and insurance domain, utilizing Azure Cloud Infrastructure.
Certification
DP 203: Microsoft Certified Azure Data Engineering, Microsoft, 12/2024, Present
Timeline
DP 203: Microsoft Certified Azure Data Engineering, Microsoft, 12/2024, Present
12-2024
Azure Data Engineer
Tata Consultancy Services Ltd.
08.2021 - Current
Btech In Electrical Engineering -
Maulana Abul Kalam Azad University
08.2016 - 05.2020
Similar Profiles
Vrunda ChindhadeVrunda Chindhade
HR Manager at Tata Consultancy Services, TCS, Tata Consultancy Services LimitedHR Manager at Tata Consultancy Services, TCS, Tata Consultancy Services Limited
Sreya BasuSreya Basu
Procare Analyst at Tata Steel(Tata Consultancy Services)Procare Analyst at Tata Steel(Tata Consultancy Services)
Arun VArun V
Program Manager at Tata consultancy services | Financial Ombudsman ServicesProgram Manager at Tata consultancy services | Financial Ombudsman Services