Harsh Sharma
Pune
Summary
Results-driven Data Engineer with 4+ years of project experience. Specializing in end-to-end development and design of ETL solutions and infrastructures. Deep expertise in data architecture, pipeline development, and big data technologies. Proven track record of optimizing data workflows, enhancing system efficiency, and driving business intelligence initiatives. Strong collaborator who thrives in evolving project demands. Prioritizing impactful results through teamwork and innovation. Proficient in SQL, Python, Big Data Handling, and cloud platforms. Strategic approach to data management and problem-solving. Dedicated to delivering exceptional outcomes for organizations.
Overview
5
5
years of professional experience
1
1
Certification
Work History
Sr. Data Engineer
Principal Global Services
10.2024 - Current
- Developed end-to-end solutions based on stakeholders requirements and represented myself as a direct point of contact for communication between client and team
- Worked efficiently with financial data, understanding the business and requirements to deliver the best possible solutions
- Redeveloped and deployed a new ETL process using Azure and Databricks to reduce costs by 40% and increase process efficiency, thereby reducing the processing time
- Developed a dashboard that takes data from Azure Analysis Services/Synapse, capable of generating multi-perspective views as well as graphical visuals representing different findings and insights
- Automated the data refresh process through ADF for better data analysis
Data Engineer
Principal Global Services
11.2020 - 10.2024
- Worked on various ETL and Reporting technologies(ADF, Databricks, Power BI, SQL)
- Worked with VM's and integration runtimes to access secure servers and used ADF for Extracting, Loading and Transforming the data in a relational Database
- Built a unified system of categorized cluster of Data by applying various Azure services like Logic
- Implemented CI/CD practices by developing custom pipelines on Azure DevOps for Database, Analysis Services, and ADF which enhanced automation aspects of the project
- Also suggested various design prospective to save costs on various aspects
- Optimized data processing by implementing PySpark frameworks for big data management.
- Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
- Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
Data Science Intern
VOIPXP
01.2020 - 03.2020
- Developed a prototype dashboard for Cisco using React, Python, and GCP to visualize and analyze voice-over-internet calling within an enterprise.
- Researched and designed a Machine Learning model to predict network traffic patterns and analyze department-wise calling methods, enabling data-driven decision-making on large-scale voice data.
- Processed and analyzed large datasets in gigabytes to derive meaningful insights and improve network performance monitoring.
- Gained hands-on experience in web application development, applying best coding practices, design principles, and performance optimizations.
Education
B.Tech - Information Technology
Jaipur Engineering College And Research Centre
Jaipur10.2020
Skills
- Structured Query Proficiency
- Experienced with Python
- Cloud Data Pipeline Management
- Data Analysis Proficiency
- Informatica ETL Expertise
- Microsoft Azure and Azure DevOps Proficiency
- Databricks Platform Expertise
- AWS Cloud Proficiency
- Excel Data Analysis & Power BI Proficiency
- Experienced with Visual Studio IDE
- Big Data Analytics
- ETL Workflow Implementation
- Proficient in Git Versioning
- Data Pipeline Architecture
- Data Schema Development
- Live Data Analysis
Certification
- Deep Learning (02/2019 - 07/2019) - Forsk Technologies Pvt. Ltd.
- Data Science (02/2018 - 07/2018) - Forsk Technologies Pvt. Ltd.
Awards
- Spot award for migration of ETL process from AWS to Azure (2023 - BU level annual awards ceremony)
- Awarded Best Innovation for active contribution towards new innovative ideas. (2021- Enterprise level annual awards ceremony)
Hobbies and Interests
- Physics
- Artificial Intelligence
- Sustainability
- Fitness
- Travelling
Timeline
Sr. Data Engineer
Principal Global Services
10.2024 - Current
Data Engineer
Principal Global Services
11.2020 - 10.2024
Data Science Intern
VOIPXP
01.2020 - 03.2020
B.Tech - Information Technology
Jaipur Engineering College And Research Centre
Similar Profiles
Chaitanya VashishthChaitanya Vashishth
Data Product Manager at Principal Global ServicesData Product Manager at Principal Global Services
Awez PathanAwez Pathan
Software Engineer at Principal Global ServicesSoftware Engineer at Principal Global Services
Sai Sunil KarriSai Sunil Karri
Client Reporting Analyst at Principal Global ServicesClient Reporting Analyst at Principal Global Services