Avanish Kumar Shukla
Azure Data Engineer | ETL Engineer
Allahabad
Summary
Data Engineer with strong hands-on experience in building and maintaining Azure-based data pipelines for CRM and enterprise data. Skilled in Azure Data Factory, Databricks (PySpark), Azure Data Lake Gen2, Azure Synapse Analytics, SQL, and Python. Experienced in transforming raw data into analytics-ready datasets that support business reporting, dashboards, and decision-making.
Overview
4
4
years of professional experience
2
2
Certificates
Work History
Senior Software Engineer
Wipro
05.2025 - Current
- Designed and delivered end-to-end Azure data pipelines for enterprise CRM platforms to support large-scale analytics.
- Automated batch and near real-time data ingestion using Azure Data Factory, improving data availability, and reducing manual effort.
- Developed complex data transformations, joins, and aggregations using Azure Databricks (PySpark) on high-volume CRM datasets.
- Built data models in Azure Synapse Analytics to support BI dashboards, improving reporting efficiency by 40%.
- Leveraged Azure Data Lake Storage to solve data retention policies, improving data access reliability by 35%.
- Managed Azure SQL Database for maintaining a scalable and reliable data storage solution, improving uptime by 95%.
Analyst II Software Engineer
DXC Technology
06.2022 - 05.2025
- Developed and maintained ETL pipelines using Azure Data Factory to ingest CRM data from Dynamics 365 into Azure Data Lake Gen2.
- Performed data transformations using Azure Databricks (PySpark) for customer, sales, and campaign analytics.
- Implemented incremental data loading techniques to improve pipeline efficiency and reduce processing time.
- Modeled CRM datasets into analytics-ready schemas in Azure Synapse Analytics for reporting purposes.
- Extract, transform, and load data from source systems to Azure storage services using Azure Data Factory, Data Bricks, and Azure Data Lake Storage.
- Performed data cleansing and preparation using Python (pandas) and PySpark to ensure data quality.
Education
Bachelor of Engineering - Computer Science Engineering (BE CSE)
CHANDIGARH UNIVERSITY
PUNJAB06-2022
Skills
Cloud & Data Services: Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure Blob Storage, Azure Data Lake Gen2
Certification
Microsoft Certified: Azure Data Engineer Associate (DP-203) – Pursuing
Timeline
Senior Software Engineer
Wipro
05.2025 - Current
Analyst II Software Engineer
DXC Technology
06.2022 - 05.2025
Bachelor of Engineering - Computer Science Engineering (BE CSE)
CHANDIGARH UNIVERSITY