Harshal Rathod
Hyderabad
Summary
Data Engineer specializing in designing and optimizing end-to-end data pipelines on Azure. Experienced with Microsoft Fabric (Lakehouse, Data Engineering, Pipelines), Azure Data Factory, Azure SQL, and ADLS Gen2 to deliver scalable, secure, and analytics-ready datasets. Skilled in transforming raw data into high-quality, reliable insights to support data-driven decision-making and business outcomes.
Overview
5
5
years of professional experience
Work History
Data Engineer
Conin Technologies Pvt. Ltd.
Hyderabad
03.2023 - Current
- E-Shop Analytics and Data Pipeline Project.
- Designed and implemented end-to-end ETL processes using PySpark, Fabric notebooks, and workflows for seamless data ingestion, transformation, and loading into the Fabric Lakehouse.
- Conducted error handling, debugging, and troubleshooting to identify and resolve issues in data pipelines, maintaining data quality and integrity.
- Implemented performance optimization techniques and monitored ETL pipelines to ensure data quality, accuracy, and timely availability.
Associate Software Engineer
EMTECH
Pune
02.2021 - 02.2023
- Developed software solutions using Core php , Codeigniter Framework 3/4 and Laravel for client projects.
- Built robust solutions in heavy machinery and medical billing projects, implementing secure payment gateway and third-party API integrations to enhance operational efficiency.
- Collaborated with cross-functional teams to design, develop, and maintain scalable applications, ensuring high performance and reliability.
Education
Bachelor of Science
Sant Gadge Baba Amravati University11-2017
Skills
- Adls Gen2
- Azure Data Factory
- Azure Kay Vault
- Databricks Notebook
- Azure SQL
- Delta Lake in Fabric
- Azure Deveops
- Git, GitHub
- SQL, My SQL
- Spark
- Python, Pyspark
- ETL,ELT
- Microsoft Fabric
- Fabric Pipelines
Timeline
Data Engineer
Conin Technologies Pvt. Ltd.
03.2023 - Current
Associate Software Engineer
EMTECH
02.2021 - 02.2023
Bachelor of Science