Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic
Jatin Vij

Jatin Vij

Gurgaon

Summary

Accomplished data engineering professional with expertise in Azure technologies. Focused on optimizing costs and improving project delivery through innovative data solutions, ready to drive impactful outcomes in fast-paced environments.

Overview

13
13
years of professional experience
1
1
Certification

Work History

Associate Manager - Data Engineering

Pepsico
Gurgaon
08.2024 - Current
  • Working on the IBP project utilizing Azure Techstack, enhancing data processing efficiency.
  • Developed cost-optimized solutions using Azure Databricks and Azure Data Factory, significantly reducing operational costs.
  • Collaborated with cross-functional teams to implement Azure DevOps practices, improving project delivery timelines.
  • Working on forecasting of data for Frito Lays North America sector under IBP project.
  • Hive Metastore to Unity Catalog Migration.
  • Using Medallion architecture and populating the gold layer tables and sharing the data with external team for demand & supply planning.

Software Development Team Lead

Amdocs
Gurgaon
01.2022 - 08.2024

• Microsoft Azure , Azure Databricks, Azure Data Factory, Lakehouse Architecture, Pyspark
• Created multiple pipelines on Azure data factory & Azure Synapse.
• Worked on a project for Yarra Valley Waterworks client which is a strategic DataLake implementation project for the Government water supply in Victoria state (Australia). The client engaged Amdocs to rationalize its data infrastructure, create a unified reporting platform on the cloud and implement advanced analytics Use Cases on the Azure.
• Creation of Initial Load pipelines for bringing the data from various sources like Oracle Db , SQL Server into the ADLS Gen2 following the best practices.
• Creation of Daily delta load pipelines which is using the CDC generated data as source and writing into the ADLS Gen 2 as parquet files.
• Used the Delta Live Framework which read the parquet/CSV files and Inserted/Upserted the data into bronze layer tables.

• Built a Metadata driven architecture which is being used across the Data Ingestion and the transformation Layer.
• Enriching/Transforming the data further into the fact and dimension tables using the Azure DataBricks (Pyspark)
• Created pipeline which loaded the enriched data into the Datawarehouse (Azure Synapse -Dedicated SQL pool - which acted as the serving layer) and further triggered the Power BI dataset refreshes.
• Created Reconciliation Dashboard using Azure Databricks Dashboards.
• Used Azure Autoloader for NRT processing of Data for a source.
• Created pipeline to turn on & off the Dedicated SQL pool at a particular time.
• Discussions with Internal and External Stakeholders.
• Worked on fixing of issues which were reported by business in already productionized code.

Senior Analyst

Natwest Group(RBS)
Gurgaon
07.2018 - 01.2022

• Worked as a Senior Analyst in Core Banking and Shared Services team for RBS but, played a stretch role of a Lead for 2 years. I was leading a mixed team of RBS and Vendor resources.
• Worked on Core Modernization project.
• Strong Knowledge of Core Banking and Debit Cards domain.
• Worked on Azure Databricks and Azure Data Factory.

IT Analyst

Tata Consultancy Services
Gurgaon
07.2017 - 06.2018
  • Worked as IT Analyst for Nationwide Building Society (NBS Bank)

Core Developer

Tata Consultancy Services
Melbourne
04.2015 - 07.2017
  • Worked as Senior Developer - Core IT systems for QANTAS LOYALTY - QANTAS AIRWAYS LTD(Melbourne)

Software Developer

Tata Consultancy Services
Noida
03.2012 - 03.2015
  • Worked as Software Developer for Qantas Airways

Education

B.Tech - Computer Science

CITM(Maharshi Dayanand University)
Faridabad
08-2011

Skills

  • Azure Databricks
  • Azure Data Factory
  • Azure Data Lake
  • Microsoft Azure
  • Unity Catalog
  • Autoloader
  • Data Governance
  • Azure Data Studio
  • Azure SQL
  • Delta Live Tables
  • Azure Synapse
  • Data Ingestion
  • Amazon Web Services

Certification

  • Post Graduate Certification in Big Data Engineering, BITS Pilani
  • Microsoft Certified: Azure Data Engineer Associate
  • Microsoft Certified: Azure Administrator Associate

Timeline

Associate Manager - Data Engineering

Pepsico
08.2024 - Current

Software Development Team Lead

Amdocs
01.2022 - 08.2024

Senior Analyst

Natwest Group(RBS)
07.2018 - 01.2022

IT Analyst

Tata Consultancy Services
07.2017 - 06.2018

Core Developer

Tata Consultancy Services
04.2015 - 07.2017

Software Developer

Tata Consultancy Services
03.2012 - 03.2015

B.Tech - Computer Science

CITM(Maharshi Dayanand University)
Jatin Vij