Summary
Overview
Work History
Education
Skills
Software
Certification
Timeline
Generic
Nitin Arora

Nitin Arora

Data Engineering Lead
Bangalore

Summary

Astute Data Engineering lead with a data-driven and technology-focused approach. Communicates clearly with stakeholders and builds consensus around well-founded models. Talented in writing applications with software engineering standards and best practices

Overview

12
12
years of professional experience
5
5
Certifications
4
4
Languages

Work History

Data Engineering Lead

Databricks
11.2021 - Current
  • Set up an internal Business data lake for whole IT engineering at the organization level
  • Setting up Unity Catalog, Data governance model, security, data lineage, and auditing for People Analytics platform
  • Single-handedly built HR lakehouse on AWS infrastructure for the company's most secured data
  • Work closely with the product engineering team for customer 0 product technical feedback like unity catalog, Fivetran, workday connector, Delta sharing, etc.
  • Build and deployed LLM-based projects on different vector databases for automation in legal and financial projects
  • Work as data and solution architect with strong stakeholder management
  • Strong hands-on on multiple programming languages like Python, scala, sql, and cross-cloud platform stacks of Azure, AWS, GCP as part of day-to-day job

Data Architect and Engineering Lead

A.P Moller Maersk
03.2021 - 11.2021
  • Worked as Data Engineering Lead for Supply chain Global Data and Analytics team
  • Mentored and managed team of 15 data engineers
  • Build pipelines for real-time transaction data Ingestion through Event Hub, Azure functions, Stream Analytics, and spark structure streaming
  • Responsible for building solutions and data Architecture for new requirements and platform standards, Best practices
  • Setup cost monitoring schedules via the Logic app, Azure monitor, and DataDog(for data pipelines)
  • Implemented multiple automation via Python and Scala to improve pipeline performances and reduce the overall runtime cost
  • Setup CICD process via Jenkin, Terraform and Azure DevOps

Lead - Data Engineering

Royal Dutch Shell
12.2015 - 03.2021
  • Worked as multiple roles like data modeler, Designer, data engineer, and Lead data engineer
  • Implemented first data lake implementation for Retail platform on Microsoft Azure
  • Build end-to-end Shell Trading data lake platform with Data Engineering frameworks, Data governance, and cataloging
  • Global Data engineering lead for shell trading data platform
  • Ran statistical analyses within tools like Alteryx, Azure Databricks, Streamsets, and Synapse Analytics to process large datasets.
  • Build a customized data Ingestion framework to load the data across layers, manage the central data catalog, and enable data monitoring mechanisms
  • successfully delivered(Only engineer to work on ) an innovative retail project for real estate with a potential MVP of 20 million USD
  • Developed polished visualizations to share the results of data analyses.
  • Build communities of practices for global team learning
  • Helped with hiring and mentoring a team of big data engineers on multiple projects with complete individual contributions

Senior Software Engineer

Wipro Technologies
08.2011 - 12.2015
  • Led software development initiative as subject matter expert and primary point-of-contact for project management staff.
  • Responsible for complete data warehousing and reporting requirement development on multiple technologies
  • Trained and mentored junior developers and engineers, taught skills in tools like HANA, BI4, Tibco Spotfire, Oracle, Teradata, etc. and worked to improve overall team performance.
  • Worked with multiple clients from different domains like Banking, oil and gas, manufacturing, pharma and retail
  • Responsible for reporting development projects on various SAP tools such as Webi, Deski, Crystal, SAP Dashboards, Universe Design Tool, and Information Design Tool
  • Build analytical models on SSIS, SQL Server, and Oracle DB
  • Created multiple Informatica data flows, ETL transformations
  • Implemented slowly changing dimensions for change data capturing
  • Implemented Object-level and Row-level security, Performance tuning, Indexing, etc
  • Created DB scripts, and stored procedures on different DB’s like Oracle, SQL, and Teradata.

Education

Master of Science - Software Engineering

Birla Institute of Technology And Sciences
Pilani
04.2001 -

Bachelor of Science - Computer Engineering

Lovely Professional University
Jalandhar
04.2001 -

Skills

    Data Architecture

undefined

Software

AWS S3, ECR Kubernetes, Airflow

Azure ADF, sql database, synapse, Streaming, Eventhub

Databricks

Sql, Oracle, Terradata

SAP HANA, ABAP, BI, SAP cloud, BW

Alteryx

Tibco spotfire, BW, PowerBI, Tableau

Certification

Azure DP200(Implementing an Azure Data Solution) Certified

Timeline

Oracle Cloud Architect Associate Certified

08-2022

Data Engineering Lead

Databricks
11.2021 - Current

Data Architect and Engineering Lead

A.P Moller Maersk
03.2021 - 11.2021

Azure DP200(Implementing an Azure Data Solution) Certified

01-2021

Azure DP 201(Designing an Azure Data Solution) Certified

01-2021

Alteryx designer (data engineering and data science tool) Certified

02-2020

IBM Big Data Engineering Foundation Course Certified

06-2019

Lead - Data Engineering

Royal Dutch Shell
12.2015 - 03.2021

Senior Software Engineer

Wipro Technologies
08.2011 - 12.2015

Master of Science - Software Engineering

Birla Institute of Technology And Sciences
04.2001 -

Bachelor of Science - Computer Engineering

Lovely Professional University
04.2001 -

Similar Profiles

CREATE PROFILE
Nitin AroraData Engineering Lead