Sanket Salve
DATA ENGINEER
Aurangabad,Maharashtra
Summary
Experienced Data Engineer with a proven track record in constructing and optimizing data pipelines using AzureDatabricks, Microsoft Fabric, and Delta Lake. Proficient in SQL, Python, and ETL processes for efficient data transformation and analysis. Highly analytical mindset and strong passion for utilizing data to solve complex problems. Motivated to continuously learn and thrive within a dynamic team. Extensive hands-on experience in data systems and database design. Enthusiastic about applying SQL and Python skills to excel in the Data Engineer role while further honing them.
Overview
4
4
years of professional experience
2
2
years of post-secondary education
2
2
Certifications
Work History
Data Engineer
Sparkviz Technologies pvt LTD
Bengaluru
03.2024 - Current
- Designed and optimized ETL pipelines for efficient data movement across layers
- Developed a separate databricks notebook for medium to advanced transformations, creating dimension and fact tables in the gold layer (Data Warehouse)
- Built views on top of the gold layer to facilitate analytical reporting
- Exposed gold layer data to the analysis team in Microsoft Fabric for reporting and visualization
- Improved data quality, performance, and governance through best practices in Delta Lake and Azure Fabric
- Formulated and executed AzureDatabricks notebooks that integrated with the bronze layer, performing complex transformations on 200,000+ data records, leading to actionable insights that directly influenced strategic decision-making processes
- Designed and implemented data transformation pipelines, optimizing processing performance and ensuring data integrity
- Created another Databricks notebook to perform medium to advanced transformations, including building dimension and fact tables
Data Engineer
Sparkviz Technologies Pvt LTD
Bengaluru
03.2021 - 03.2023
- Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
- Designed scalable and maintainable data models to support business intelligence initiatives and reporting needs.
- Migrated legacy systems to modern big-data technologies, improving performance and scalability while minimizing business disruption.
Education
Bachelor of Science -
Babasaheb Ambedkar University
Aurangabad 04.2019 - 07.2021
Skills
AzureDatafactory
AzureDatabricks
Azure SQL Database
Azure Synapse
Azure Key Vault
SQL
Python
Microsoft Fabric
DevOps
Git
GitHub
Hadoop
Big Data
Certification
Microsoft Fabric DP - 700
Timeline
Data Engineer
Sparkviz Technologies pvt LTD
03.2024 - Current
Data Engineer
Sparkviz Technologies Pvt LTD
03.2021 - 03.2023
Bachelor of Science -
Babasaheb Ambedkar University
04.2019 - 07.2021