Work Preference

Summary

Overview

Work History

Education

Skills

Work Availability

Languages

Timeline

SAURABH DHOOT

Senior Data Engineer

Pune,MH

Work Preference

Work Type

Full Time

Location Preference

RemoteHybrid

Important To Me

Work-life balanceCompany CultureFlexible work hoursWork from home optionCareer advancementTeam Building / Company Retreats

Summary

Data Engineer with 5+ years of experience designing scalable data pipelines on Azure (ADF, Databricks, ADLS). Expert in PySpark and SQL, with strong experience in ETL development, Medallion Architecture, and large-scale data processing. Skilled in data warehousing, data modeling, and data governance, with a proven track record of optimizing pipelines, ensuring data quality, and delivering reliable, cost-efficient data solutions.

Overview

years of professional experience

Language

Work History

Senior Consultant

Delta Technology and Management Services Pvt. Ltd.

02.2026 - Current

Mentored junior consultants, helping them enhance their skills and contribute more effectively to projects.
Prioritized projects and project tasks depending upon key milestones and deadline dates.
Troubleshot issues by understanding issue, diagnosing root cause and coming up with effective solutions.
Collaborated with internal teams to develop customized solutions that addressed unique client needs.

Senior Software Engineer

Hexaware Technologies

06.2024 - 02.2026

Designed and implemented a unified enterprise data analytics platform on Azure, integrating structured and unstructured data into Azure Data Lake (ADLS) using Azure Data Factory (ADF), and Databricks, enabling centralized data access and governance.
Developed scalable batch and real-time ETL pipelines using ADF, Azure Databricks, PySpark, and SQL, processing over 5 TB of data to support near real-time analytics and decision-making.
Implemented Medallion Architecture (Bronze, Silver, Gold) for data transformation and enrichment, improving data quality, consistency, and reliability by 40%.
Applied data warehousing and data modeling techniques (star/snowflake schema) to build optimized, analytics-ready datasets for business intelligence use cases.
Established data governance frameworks, including metadata management, data lineage, access control (RBAC), and audit logging, ensuring 99.9% data availability and 100% traceability for compliance.
Collaborated with cross-functional teams to align data solutions with business KPIs, improving decision-making speed by 30%, and enhancing overall analytics efficiency.
Managed multiple data engineering projects simultaneously, delivering high-quality solutions within strict timelines.

Data Engineer

AAYS Analytics

01.2023 - 05.2024

Led the design and development of a scalable Vendor Cyber Risk Management (VCRM) data platform on Azure, managing the end-to-end data lifecycle from ingestion to analytics, and governance.
Designed data architecture integrating multiple cyber intelligence sources into Azure Data Lake (ADLS), with a curated data warehousing layer for analytics-ready datasets, and improved vendor visibility.
Built and optimized scalable data ingestion pipelines using Azure Data Factory (ADF) for batch and near real-time processing of high-volume data.
Developed ETL workflows using Azure Databricks, PySpark, and SQL for large-scale data transformation and enrichment.
Applied data modeling (star/snowflake schema) to design efficient datasets, improving query performance, and reporting.
Automated orchestration and monitoring in ADF, achieving 99.9% reliability, and reducing manual effort by 60%.
Optimized pipelines using partitioning and incremental processing, improving performance, and reducing compute costs.
Collaborated with stakeholders to align data solutions with compliance and business needs, improving risk visibility and decision-making.

Big Data Engineer

airisDATA India Pvt Ltd

07.2021 - 01.2023

Wrote and optimized complex Hive queries for large-scale data processing, improving query performance through partitioning, bucketing, and efficient joins.
Created custom Splunk queries and reports to support root cause analysis, and improve operational visibility of data workflows.
Actively handled Jira-based sprint tasks, including feature enhancements, bug fixes, and production support, ensuring smooth delivery in agile environments.
Participated in backlog grooming, sprint planning, and effort estimation using Jira, improving team productivity and task prioritization.
Developed dynamic and parameterized DAGs in Apache Airflow to support reusable and scalable workflow orchestration.
Designed and managed batch workflow orchestration using Control-M, handling job scheduling, dependency resolution, and failure recovery to ensure high availability and timely delivery of data pipelines.

Junior Developer

Clodura Systems

04.2021 - 06.2021

Proficient in optimizing query performance through DDL scripting for Hive table creation.
Adept at validation using Hive queries.
Skilled in task automation via shell scripting.
Experienced in managing data import/export tasks with Sqoop.
Capable of efficiently resolving client-raised JIRA tickets.

Education

PG Diploma - DBDA

Centre for Development of Advanced Computing (CDAC)

01-2020

B.Tech/B.E. - Electronics/Telecommunication

Babasaheb Ambedkar Marathwada University (BAMU)

Aurangabad

01-2019

Skills

Azure Services : Data Factory, Dataricks, Synapse

Database : SQL, SSMS

ETL development

Work Availability

monday

tuesday

wednesday

thursday

friday

saturday

sunday

morning

afternoon

evening

swipe to browse