Aditya Jadhao
Pune
Summary
Organized and dependable candidate successful at managing multiple priorities with a positive attitude. Willingness to take on added responsibilities to meet team goals with skills and experience in data Engineering with a solid background in designing, implementing, and maintaining data pipelines, ETL processes, and data warehouses. Proficient in utilizing a variety of programming languages and tools to extract, transform, and load data for analysis and reporting purposes. Expertise in optimizing data infrastructures to support business intelligence and analytics goals. Strong problem-solving and communication skills with a proven track record of delivering high-quality data solutions.
Overview
2
2
years of professional experience
Work History
Data Engineer
SE-II, Parkar Digital
03.2023 - Current
- Spearheaded design and implementation of data workspaces within Microsoft Azure Synapse Analytics (MS Fabrics) for healthcare clients, leveraging PySpark notebooks and lake house architectures to streamline data processing and analytics workflows.
- Established robust landing zones in bronze layer for efficient raw data ingestion, ensuring data integrity and accessibility for downstream analytics.
- Developed and integrated comprehensive notebook logging and alerting mechanisms to monitor data pipeline health, enabling proactive failure detection and minimizing operational disruptions.
- Conducted thorough data cleaning, validation, and transformation processes in the silver layer, significantly enhancing data quality and reliability for analytical applications.
- Engineered sophisticated calculations and aggregations in the gold layer to support advanced client reporting and analytics, driving strategic decision-making with actionable insights.
- Optimized PySpark code for improved performance and efficiency, employing best practices such as partitioning strategies, broadcast joins, and caching to reduce processing times and resource consumption.
- Fostered close collaboration with cross-functional teams for data validation and quality assurance, ensuring alignment with business requirements and maintaining high standards of data governance.
- Identified and implemented process improvements, leading to the development of more efficient PySpark notebooks, lake houses, and fabric implementations, enhancing the scalability and effectiveness of the data ecosystem.
Associate Data Engineer
SE-I, Parkar Digital
04.2022 - 03.2023
- Monitored and configured alerts for pipeline failures, ensuring rapid response and resolution to maintain high availability and reliability of data processing workflows.
- Created, troubleshooted, modified, and developed Azure Data Factory (ADF) pipelines and complex SQL queries, optimizing data extraction, transformation, and loading (ETL) processes for enhanced data integration and accessibility.
- Automated intricate manual processes using Azure Data Factory, significantly reducing operational overhead and improving efficiency across data management tasks.
- Configured and managed SQL queries and ADF pipelines within Azure Repositories, promoting version control and collaboration among team members for streamlined development and deployment cycles.
- Authored comprehensive runbook to expedite onboarding process for new users, providing clear guidance on system processes and operational procedures.
- Designed and implemented ADF pipelines for wide range of data integration tasks, tailoring solutions to meet specific business requirements and data flow needs.
- Scheduled triggers for ADF pipelines according to varying requirements (monthly, weekly, daily, or ad-hoc), ensuring timely execution of data processing jobs and report generation.
- Resolved pipeline issues reported via JIRA tickets, implementing permanent fixes to prevent recurrence and improve overall system stability.
- Conducted extensive Data Quality Assurance testing, validating integrity and accuracy of data throughout ETL lifecycle to uphold data governance standards and support accurate analytics and reporting.
Trainee Software Engineer
Parkar Digital
01.2022 - 03.2022
- Assisted in the development and maintenance of Azure Data Factory (ADF) pipelines, contributing to the optimization of data integration processes and workflow efficiencies.
- Supported data migration projects, playing a key role in transitioning data across platforms while ensuring data integrity and consistency.
- Participated in data validation tasks, verifying the accuracy and completeness of data post-migration to meet quality standards and business requirements.
Education
Bachelor of Engineering - Computer Science Engineering
G H Raisoni Institute of Engineering And Technology (GHRIETN)
Nagpur08.2021
Skills
- ETL development and data pipeline design
- Data Warehousing
- Data Modeling
- Data Pipeline Design
- SQL Expertise
- Data Analysis
- Machine Learning
- Pyspark
- Big Data Processing
- Data Migration
- DBT
- Azure data factory
- Machine Learning
- Big Data Processing
- Data Migration
- DBT
Accomplishments
- Azure Data engineer associate(DP-203)
Languages
- English
- Hindi
Timeline
Data Engineer
SE-II, Parkar Digital
03.2023 - Current
Associate Data Engineer
SE-I, Parkar Digital
04.2022 - 03.2023
Trainee Software Engineer
Parkar Digital
01.2022 - 03.2022
Bachelor of Engineering - Computer Science Engineering
G H Raisoni Institute of Engineering And Technology (GHRIETN)
Similar Profiles
Nilesh PatilNilesh Patil
Senior Data Analyst at Parkar DigitalSenior Data Analyst at Parkar Digital
ANNA PAZYNYCHANNA PAZYNYCH
Licensing and contracting specialist at MHP SE • DEPT. OF INFORMATION AND DIGITAL TECHNOLOGIESLicensing and contracting specialist at MHP SE • DEPT. OF INFORMATION AND DIGITAL TECHNOLOGIES
ANIL OJHAANIL OJHA
Junior Developer at Digital Service Australia II PTY LTD - VITABLEJunior Developer at Digital Service Australia II PTY LTD - VITABLE