Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

Nikhil Bagesar

Summary

As data professional expertise in SQL, Snowflake, and Azure ADF, Databricks seeking to leverage strong technical skills and problem-solving abilities in a challenging role. Eager to contribute to a dynamic team, driving efficiency and innovation in data management and analytics

Overview

4
4
years of professional experience
1
1
Certification

Work History

AZURE Data Engineer

INDUSIND
12.2023 - Current
  • Developed an automated data migration system using Azure Data Factory and PySpark, reducing transfer time by 30%.
  • Achieved 40% faster Spark job processing and 20% lower cloud costs through performance tuning and optimization.
  • Improved data accuracy in Azure Data Lake Storage by 30% through cleansing and standardization.
  • Designed pipelines for two source systems – Finacle and VisionPlus.
  • Ensured data accuracy via validation checks, duplicate record removal, and schema enforcement.
  • Created incremental pipelines from Oracle server to Azure Data Lake Storage.
  • Built incremental pipelines for Finacle (database source) and VisionPlus (SFTP file server).
  • Building Pipeline Incremental pipeline for Visionplus which is file server SFTP type
  • Responsible for production migration activities and post-migration data validation.
  • Leveraging Azure data lake storage (ADLS) and Azure SQL Database for secure, reliable and optimized data storage
  • Secured access to storage accounts using Azure Key Vault for managing Secrets and credentials.
  • Followed agile methodologies and used Git for version control and collaboration
  • Built history and incremental pipelines for migrating Credit Bureau data
  • Experienced in scheduling triggers using Azure Data Factory
  • Managed production migration and performed post-migration validation
  • Optimized data processing speed by 50% through ADF Copy Activity enhancements.
  • Developed Databricks scripts for reconciliation of source and ADLS row counts

AZURE Data Engineer

AXIS BANK
01.2022 - 10.2023
  • Design and Implementing scalable data pipelines using Azure Data Factory, Databricks and pyspark for efficient data integration and transformation

Snowflake Developer

Uchalo
07.2022 - 12.2022
  • Created a project structure for migrating JavaScript code to Snowflake stored procedures
  • Developed JavaScript-based Snowflake procedures to parse JSON data from Snowflake tables
  • Designed table-specific functions to read data into variables for transformation.
  • Built a map method to insert all processed data into final tables in a single operation, improving query performance.
  • Integrated DBT with Snowflake for version control.
  • Built DBT models to reduce execution time.
  • Triggered DBT models using Airflow DAGs.

Education

Bachelor of Engineering (B.E) - MECH

Priyadarshini

Post Graduation Diploma (PG) - Advanced Computing

CDAC

Master in Business Administration (MBA) - Marketing and International Business

Sunbeam

Skills

  • MySQL
  • Python
  • Databricks
  • Snowflake
  • DBT
  • PySpark
  • Azure DevOps
  • JavaScript
  • ADF (Azure Data Factory)
  • Agile
  • Amazon S3
  • Apache Spark
  • AWS
  • ETL
  • Azure Repos
  • Azure
  • Azure Data Lake
  • Azure SQL
  • Azure ADLS
  • JSON
  • GIT
  • SQL
  • IAM
  • ETL development
  • Data warehousing
  • Data pipeline design
  • Data migration
  • Data security
  • Metadata management
  • Data warehousing expertise

Certification

  • Snowflake : Snowpro Core Certification
  • Azure (Microsoft): Databricks Certified Data Engineer Associate

Timeline

AZURE Data Engineer

INDUSIND
12.2023 - Current

Snowflake Developer

Uchalo
07.2022 - 12.2022

AZURE Data Engineer

AXIS BANK
01.2022 - 10.2023

Post Graduation Diploma (PG) - Advanced Computing

CDAC

Master in Business Administration (MBA) - Marketing and International Business

Sunbeam

Bachelor of Engineering (B.E) - MECH

Priyadarshini

Similar Profiles

CREATE PROFILE
Nikhil Bagesar