3+ years of experience in Azure data engineering with expertise in designing and optimizing scalable data pipelines using Azure services, PySpark, and SQL. Proficient in ETL workflows, data warehousing, and data orchestration, focusing on Azure Databricks, Azure Data Factory, and Delta Lake. Skilled in transforming, cleansing, and tuning data for improved performance. Leverage PySpark, Azure Databricks, Azure Data Lake Storage, and Delta Lake to ensure efficient data movement and analysis.
Hi, I’m
SIDDHI TIWARI
JUNIOR ANALYST
Lucknow,UP
Summary
Overview
3
years of professional experience
Work History
C5I
Junior Data Analyst
01.2022 - Current
Job overview
- Developed interactive dashboards in Power BI And AWS Quicksight, improving business reporting efficiency by 30%.
- Designed and optimized ETL pipelines using Python and SQL, reducing data processing time by 25%.
- Collaborated with stakeholders to define KPIs and automate data workflows.
- Performed data cleaning, transformation, and modeling for large datasets.
- Developed optimized PySpark scripts to process 200+ million rows daily, reducing execution time by 25%
- Built custom Azure Data Factory pipelines for seamless data integration and movement across Azure Blob Storage, ADLS, and Delta Lake
- Utilized Delta Lake for ACID transactions, schema enforcement, and versioning, ensuring data reliability and consistency
- Automated data validation processes, reducing manual data quality checks by 80%
- Facilitated data-driven decision making by creating custom reports tailored to stakeholder needs and preferences.
Education
DR ABDUL KALAM TECHNICAL UNIVERSITY
Bachelor of Technology from Computer Engineering
04.2001
University Overview
Skills
Power BI
Accomplishments
Accomplishments
- Spot Award @ course5i
- 2x Team Excellence Award @course5i
Timeline
Junior Data Analyst
C5I
01.2022 - Current
DR ABDUL KALAM TECHNICAL UNIVERSITY
Bachelor of Technology from Computer Engineering
04.2001
Similar Profiles
Zahid FarooqZahid Farooq
Cloud Architect – PADLE Team - MARS at C5iCloud Architect – PADLE Team - MARS at C5i
Prashant KumarPrashant Kumar
Senior Microservice Developer at C5ISenior Microservice Developer at C5I
Amit AvasthiAmit Avasthi
Senior Director of Engineering at C5iSenior Director of Engineering at C5i
Abhishek SinghAbhishek Singh
Senior AI Scientist at C5iSenior AI Scientist at C5i
Abuzar FarhatAbuzar Farhat
General Manager at Farhat Pvt. Ltd. (Family Business)General Manager at Farhat Pvt. Ltd. (Family Business)