Madiha Sultan
Bhopal
Summary
Accomplished Data Engineer with a proven track record at KPMG, specializing in data pipeline design and optimization. Successfully reduced processing time by 50% while enhancing data quality through robust ETL processes. Adept at cross-functional collaboration and team leadership, leveraging skills in SQL and Azure Data Factory to drive impactful data solutions. Highly competent Data Engineer with background in designing, testing, and maintaining data management systems. Possess strong skills in database design and data mining, coupled with adeptness at using machine learning to improve business decision making. Previous work resulted in optimizing data retrieval processes and improving system efficiency.
Overview
5
5
years of professional experience
1
1
Certification
Work History
Data Engineer
Fractal Analytics
Pune
10.2023 - Current
- Supported and monitored 100+ pipelines.
- Enhance the. Existing pipelines were modified as per the client's requirements.
- Optimize the process and pipelines, and reduce the timing from 8 hours to 4 hours.
- Worked on data mesh architecture and created multiple processes on top of the centralized architecture.
- Created logic apps to drop files from SharePoint to ADLS.
- Created pipelines to fetch data from APIs, SharePoint, and SAP BW sources.
- Created notebooks to implement multiple transformations based on business requirements.
- Conducted rigorous testing and validation of data pipelines to ensure accuracy and completeness of data.
- Used Azure DevOps to maintain tasks and deployment of code.
- Handled two freshers and helped them with onboarding, and guided them initially about data engineering projects.
Data Engineer
KPMG
Pune
10.2022 - 10.2023
- Designed data pipelines to integrate diverse data sources efficiently.
- Developed ETL processes to ensure data quality and reliability.
- Collaborated with cross-functional teams to identify data needs and requirements.
- Maintained data architecture documentation for clarity and consistency.
- Utilized SQL and Python for data manipulation and analysis tasks.
- Analyzed user requirements, designed and developed ETL processes to load enterprise data into the Data Warehouse.
- Optimized SQL queries and database schemas for performance improvements in data retrieval operations.
- Monitored data systems performance, identifying bottlenecks and implementing solutions to maintain system efficiency.
- Trained non-technical users and answered technical support questions.
- Migrated notebooks from Azure Synapse Analytics to Azure Databricks.
Data Analyst
KPMG
Bnagalore
10.2020 - 10.2022
- Collaborated with cross-functional teams to support data-driven decision-making processes.
- Analyzed large datasets to identify trends, patterns and correlations for business insights.
- Leveraged SQL queries to extract, transform and load data into databases.
Education
Bachelor of Engineering - Computer Science
UIT- RGPV
Bhopal09-2020
Higher Secondary - PCM
Model Hr. Sec. School
Bhopal04-2016
Skills
- Data pipeline design
- Pyspark
- Python
- SQL
- Databricks
- Azure Logic Apps
- ADLS
- Azure Data Factory
- Data mesh
- ETL processes
- SQL optimization
- Team leadership
- Data architecture
- Cross-functional collaboration
- Deployment via Azure DevOps
- Verbal communication
Certification
- Azure fundamentals (AZ-900)
- Azure Data Fundamentals (DP-900)
- Azure Data Engineer Associate (DP-203)
- GCP ACE
- Databricks Fundamentals
Languages
Hindi
First Language
English
Proficient (C2)
C2
Urdu
Proficient (C2)
C2
Timeline
Data Engineer
Fractal Analytics
10.2023 - Current
Data Engineer
KPMG
10.2022 - 10.2023
Data Analyst
KPMG
10.2020 - 10.2022
Bachelor of Engineering - Computer Science
UIT- RGPV
Higher Secondary - PCM
Model Hr. Sec. School