Sanket Bhagwat
Nagpur
Summary
Experienced Data Engineer with 5+ years in data-related domains, including 4+ years in Data Engineering. Proficient in Databricks, ELT/ETL, SQL, Azure, Python, PySpark, Spark, ADF and Power BI to create scalable, high-performance data solutions. Proven ability to optimize workflows, enhance system performance, and implement security measures for cloud-based analytics platforms while excelling in BI reporting and data visualization.
Overview
5
5
years of professional experience
1
1
Certification
Work History
Application Developer
IBM
02.2026 - Current
- Integrated data from SAP BPC, Excel files, and web-based sources to enable unified processing.
- Developed and orchestrated data pipelines using Azure Databricks with Delta Lake for ACID-compliant storage.
- Performed complex data calculations and validations to ensure accurate and consistent data loads from multiple systems.
- Optimized 100+ business calculations, enhancing accuracy and efficiency in financial reporting and analytics.
- Collaborated with finance teams to align data models with reporting and compliance standards.
- Collaborated with the Power BI reporting team to understand table structure requirements and design materialized views and tables accordingly.
Consultant II
Neudesic an IBM Company
08.2025 - 01.2026
- Orchestrated data pipelines in Databricks using Delta Lake to ensure reliable, ACID-compliant storage.
- Optimized workflows through caching, cluster configuration, and parallelism to achieve 30% faster processing.
- Automated job monitoring and alerting systems to enhance proactive issue detection.
- Validated transformations with data analysts to maintain end-to-end data quality.
- Integrated data from multiple real-time sources such as flight operations, weather APIs, and booking systems.
- Ensured data reliability and recovery through checkpointing and incremental load strategies.
Senior Consultant
NICE SOFTWARE SOLUTIONS
02.2021 - 07.2025
- Proficient in implementing and maintaining Data Lakehouse solutions on Databricks, enabling centralized storage, efficient processing, and high-quality data access for analytics and reporting needs.
- Developed both real-time and batch data pipelines on Databricks to support a variety of use cases, from operational dashboards to advanced machine learning analytics.
- Created and manipulated large-scale data using modern data engineering practices such as incremental loads, optimized joins, partitioning, and schema evolution based on client requirements.
- Utilized expertise in SQL, Python, data warehousing, and data governance to enhance data quality, security, and reliability across projects.
- Experienced in data modeling (star schema, snowflake schema), ETL/ELT processes, and streaming analytics, enabling scalable and efficient data solutions.
- Led projects by orchestrating end-to-end tasks — from data ingestion to solution deployment — while ensuring high-quality product delivery within timelines.
- Conducted requirement gathering, data analysis, and validation to transform business needs into actionable data-driven solutions.
- Proficient in Power BI for building interactive dashboards and reports, following best practices in data modeling, DAX calculations, and visualization techniques.
- Worked extensively on Power BI dashboard performance optimization, including managing large crosstabs, multiple filters, slicers, and parameters for a smooth user experience.
- Created wireframes, mockups, and interactive designs based on client specifications to align project goals and enhance user experience.
Education
Bachelor of Engineering - IT
RTMNU
Nagpur, India01.2020
Skills
- Data Engineering
- Pyspark
- Power BI
- Databricks
- Spark
- Power Apps
- Data modeling
- SQL
- Python
- Azure
- ADF
- Informatica
Certification
- Databricks Certified Data Engineer Associate
- Databricks Lakehouse Fundamentals
- Business Analytic Professional (Edvancer)
Projects
1) JetBlue — Senior Data Engineer
Designed scalable data pipelines and workflows.
Implemented Delta Lake for ACID-compliant storage, ensuring data accuracy.
Optimized workflows using caching, cluster configurations, and job parallelism, reducing processing time by 30%.
Managed code versioning with Git and Databricks Repos for efficient collaboration.
Led project delivery including timelines and resource allocation.
Established naming conventions, testing practices, and CI/CD standards across domains.
2) Adani — Senior Data Engineer
Transformed and cleaned data using PySpark in Databricks.
Scheduled and monitored ETL jobs via Databricks Jobs.
Implemented logging and error handling for troubleshooting.
Configured access controls for Databricks users.
Optimized SQL and Spark queries for performance improvements.
Maintained clear documentation for data flows and transformations.
3) AstraZeneca — Senior Power BI Developer
Integrated Row-Level Security (RLS) for department-based access control.
Developed interactive dashboards with custom calculations and parameters.
Created comprehensive technical documentation and defined best practices.
Timeline
Application Developer
IBM
02.2026 - Current
Consultant II
Neudesic an IBM Company
08.2025 - 01.2026
Senior Consultant
NICE SOFTWARE SOLUTIONS
02.2021 - 07.2025
Bachelor of Engineering - IT
RTMNU