Shubham Waghe
Pune
Summary
Azure Data Engineer with 4.8 years of experience in designing and implementing robust data storage solutions and maintaining efficient data pipelines. Proficient in Azure cloud services, including Azure Blob and Data Lake Store, Azure SQL Database, and Databricks, with a strong focus on data quality and performance optimization. Skilled in migrating on-premises databases to Azure environments and developing Spark applications using PySpark for data transformation and analysis. Expertise in various phases of project life cycles (Design, Analysis, Implementation, and Testing). Collaborates effectively with cross-functional teams to deliver actionable insights through data analytics and Power BI reporting.
Overview
5
5
years of professional experience
Work History
Software Engineer
Primus Global Technologies (C2H role)
Pune
01.2025 - 06.2025
- Developed data pipelines to extract and transform data from various sources, like on-premise SQL Server, APIs, Snowflake, etc.
- Implemented efficient data storage solutions using Azure Blob and Data lake storage.
- Collaborated with data scientists and analysts to understand data needs and implement appropriate data models and structures.
- Optimized SQL queries and database schemas for performance improvements in data retrieval operations.
- Implementing medallion architecture while doing data transformation using Databricks notebooks.
- Automated data quality checks and error handling processes to ensure the integrity and reliability of datasets.
Data Engineer
ERP Consulting
Pune
07.2024 - 01.2025
- Developed data pipelines to extract, transform, and load data from various sources. Data migration from on-premise SQL Server to Azure Cloud.
- Used Databricks for data transformation.
- Utilized SQL for querying and managing relational databases effectively.
- Participated in agile development processes, contributing to sprint planning, stand-ups, and reviews to ensure timely delivery of data projects.
- Designed data warehousing solutions, applying dimensional modeling techniques for optimized data retrieval.
Data Engineer
Innerbit Technologies
Ahmednagar
09.2020 - 05.2024
- Collaborated with team members to identify data requirements for projects.
- Assisted in maintaining data integrity and quality across databases.
- Created stored procedures for automating periodic tasks in SQL Server.
- Developed data pipelines to load data from various sources and perform data transformation using Databricks.
- Conducted rigorous testing and validation of data pipelines to ensure accuracy and completeness of data.
Education
Bachelor of Engineering -
Modern Education Society's College of Engineering
Pune, India06-2019
Skills
- Data pipelines
- Azure Data Factory
- Azure Databricks
- Azure Blob and Data Lake
- Azure SQL
- Azure DevOps
- Azure Functions and Logic Apps
- Azure Synapse Analytics
- Azure Key Vault
- Python and PySpark
- ETL processes
- Data warehousing
- Agile development
- Data modeling
- JIRA tools
- Github
- Terraform
- Docker and Kubernetes
Timeline
Software Engineer
Primus Global Technologies (C2H role)
01.2025 - 06.2025
Data Engineer
ERP Consulting
07.2024 - 01.2025
Data Engineer
Innerbit Technologies
09.2020 - 05.2024
Bachelor of Engineering -
Modern Education Society's College of Engineering
Similar Profiles
Vaibhav SanapVaibhav Sanap
Oracle PL/SQL Developer at Primus Global Technologies PVT LTDOracle PL/SQL Developer at Primus Global Technologies PVT LTD
Manojkumar Manojkumar null
Senior Android Tv Launcher App Developer at Primus Global Technologies Pvt LtdSenior Android Tv Launcher App Developer at Primus Global Technologies Pvt Ltd
Mahalakshmi MMahalakshmi M
Technical Lead at PRIMUS Global Technologies - Contractor in WiproTechnical Lead at PRIMUS Global Technologies - Contractor in Wipro
Niraj DigheNiraj Dighe
Lead Software Engineer at Cloud Software GroupLead Software Engineer at Cloud Software Group
Shubham NayarShubham Nayar
Senior Associate 2 at Acko General InsuranceSenior Associate 2 at Acko General Insurance