Summary
Overview
Work History
Education
Skills
Certification
Languages
Timeline
Generic

Nilesh Lokhande

Pune

Summary

Results-driven Azure Data Engineer with 4 years of experience in building scalable data pipelines and cloud-based architectures for data warehousing projects. Proficient in Azure Data Factory, SQL, and Spark. Proven track record in optimizing data workflows, reducing processing times by 30%, and ensuring seamless data integration.

Overview

4
4
years of professional experience
1
1
Certification

Work History

Data Engineer-II

Amdocs
Pune
08.2023 - Current
  • Worked on Azure Data Factory (ADF), Azure Databricks and Azure SQL database.
  • Designed and implemented scalable ETL pipelines using Azure Data Factory (ADF) and Databricks.
  • Created Azure Data Factory pipelines to pull data from on-premise Oracle databases and Azure SQL DB to Azure Data Lake storage as a full load daily into corresponding folders.
  • Integrated data from multiple sources (SQL, Blob Storage) into Azure Data Lake.
  • Optimized data processing workflows, reducing runtime by 25%.
  • Ingested and stored multi-source data into Azure Data Lake Storage (ADLS) Gen2, improving data accessibility by 30%.
  • Documented data pipeline architecture and created user guides for team knowledge sharing.
  • Collaborated with cross-functional teams to define data requirements and business goals.

Data Engineer - I

Amdocs
Pune
08.2021 - 08.2023
  • Extracted data from various sources like MS-Sql server, Manual files, and Blob Storage.
  • Developed and deployed ETL pipelines using Azure Data Factory (ADF) and Databricks.
  • Having experience in transforming and loading data into delta tables in Azure Databricks.
  • Good understanding of storing and reading data from cloud storage like Azure blob storage.
  • Improved data load efficiency by leveraging Spark for parallel processing in Databricks.
  • Conducted performance tuning and optimization of data pipelines for cost efficiency.
  • Azure SQL used to perform the query operations.
  • Good understanding of storing and reading data from cloud storage like Azure blob storage.

Education

M.SC. - Computer Science

Pune University
01.2022

B.SC. - Computer Science

MIT ASCS
Pune
01.2020

Skills

  • ADF
  • Pyspark
  • Databricks
  • Azure Synapse
  • Hadoop
  • SQL Server
  • Linux
  • Python
  • GitHub
  • SQL

Certification

  • Az-900 Azure Fundamentals
  • DP-900 Data Fundamentals

Languages

  • English
  • Hindi
  • Marathi

Timeline

Data Engineer-II

Amdocs
08.2023 - Current

Data Engineer - I

Amdocs
08.2021 - 08.2023

M.SC. - Computer Science

Pune University

B.SC. - Computer Science

MIT ASCS

Similar Profiles

CREATE PROFILE
Nilesh Lokhande