Summary
Overview
Work History
Education
Skills
Timeline
Generic

Pratik Patil

Pune

Summary

Results-driven Azure Data Engineer with 2+ years in designing scalable cloud data platforms leveraging Azure Data Factory, Databricks, and PySpark. Developed Lakehouse architectures and optimized Spark pipelines for efficient data processing. Expertise in Power BI data modeling and enterprise dashboard development enhances data-driven decision-making.

Overview

2
2
years of professional experience

Work History

Azure Data Engineer

Finabits Technologies
pune
07.2024 - 08.2026
  • Helped build end-to-end ETL pipelines in Azure Data Factory (ADF) to ingest, orchestrate, and combine data from on-prem SQL Server, APIs, and flat files (CSV/JSON) into Azure Data Lake Storage Gen2 (ADLS).
  • Supported migration of large-scale on-prem SQL Server workloads to Azure by using Self-Hosted Integration Runtime (SHIR) and tuning copy activity with parallelism, partitioning, and cost-focused methods..
  • Used Azure Databricks (PySpark) for data cleansing, transformation, validation, and deduplication to produce analytics-ready datasets.
  • Built incremental loading (CDC) pipelines with Delta Lake merge to manage inserts, updates, and deletes without full data reloads.
  • Created SCD Type 2 Delta Lake models to maintain historical dimension data for downstream analytics and reporting.
  • Streamlined ADF orchestration workflows to improve pipeline latency and increase operational efficiency.
  • Delivered curated silver and gold layer datasets to Azure SQL Database and Power BI, enabling faster query performance and enhancing governance and lineage tracking.
  • Automated schema drift handling and file compaction with Databricks notebooks, reducing manual work and lowering operational overhead.
  • Built Python automation scripts (Pandas, NumPy, datetime) for data validation, reporting, and ad-hoc analysis to improve productivity and reduce repetitive tasks.
  • Collaborated with cross-functional teams to deliver secure, scalable data solutions that enabled data-driven decision-making and supported business intelligence initiatives.

Education

Bachelor of Science - Computer Science

Shivaji University
kolhapur
06-2019

Skills

  • Azure Data Factory
  • Azure Databricks
  • Azure Data Lake Storage
  • Delta Lake Modeling
  • ETL Pipeline Design
  • Azure SQL database
  • SQL
  • PostgreSQL
  • MySQL
  • Python
  • Spark
  • Azure cloud
  • GitHub

Timeline

Azure Data Engineer

Finabits Technologies
07.2024 - 08.2026

Bachelor of Science - Computer Science

Shivaji University
Pratik Patil