Accomplished Data Engineer with 17 years of experience in designing and managing data solutions for high impact projects. Skilled in leveraging modern data tools and technologies to deliver actionable insights and enhance business performance.
Overview
8
8
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
HCL Technologies
Noida
02.2022 - Current
Developed an end to end data engineering pipeline for a top Banking Project, enhancing the data analysis and customer segment.
Ingested and stored multi source data into Azure Data Lake storage(ADLS)Gen2,Improving data accessibility by 30%.
Processed and transformed raw data with Azure synapse Analytics resulting in 25% reduction in data processing time.
Used data factory activities to make the production pipeline for data copy with transformation.
Fixed broken and failed Azure data factory pipelines on prod.
Data Engineer-I
NTT DATA
Noida
06.2020 - 02.2022
Managed tasks related to Azure Data Factory (ADF), Azure Databricks, and Azure SQL database.
Implemented an efficient Azure data factory pipeline to extract and store full load data daily from on Premise Oracle database and Azure SQL DB in corresponding folders within the Azure Data Lake storage.
Extracted data from various sources like MS-Sql SERVER, Manual files and Blob storage.
Adept at transforming and loading data with ease into delta tables using Azure Databricks.
Testing Engineer Advisor
NTT DATA
Noida
02.2016 - 06.2020
Performed DB testing of application using Sql.
Develop and execute complex SQL queries to validate data transformations and migrations.
Executed data validation tests to ensure accuracy and completeness of data.
Automated database testing processes using Selenium and Python scripts.
Designed and executed test plans and test cases for database systems.
Education
M.C.A - Computer Engineering
B.I.T, MESRA,
RANCHI
06-2005
B.C.A - Computer Engineering
B.I.T, MESRA,
RANCHI
12-2002
Skills
ADF
Pyspark
Databricks
Azure Synapse
SQL
Python
Java
Github
Agile Practitioner
Certification
AZ-900-Microsoft Certified Azure Fundamentals.
AD-900 Microsoft Certified Azure Data Fundamentals.
ETL Lead /Onshore Technical Business Analyst at HCL Technologies India & HCL Technologies NZ LtdETL Lead /Onshore Technical Business Analyst at HCL Technologies India & HCL Technologies NZ Ltd