Summary
Overview
Work History
Education
Skills
Certification
Hobbies and Interests
Timeline
Generic

Rohit Jha

Bengaluru

Summary

Experienced Lead Data Engineer with 11.9 years of expertise in ETL in PySpark, Spark SQL and SAP BW. Proficient in end to end development and in support activities. Skilled in tools like Spark Structured Streaming. Proven track record in creating dashboards for visual representation of key metrics and optimizing resource utilization. Adept at collaborating within collaborative team environments and adhering to industry standards and regulatory requirements. Looking for exploring opportunities as a Technical Architect/Lead Data Engineer in the Apache Ecosystem.

Overview

12
12
years of professional experience
1
1
Certification

Work History

Lead Data Engineer

Airbus
11.2019 - Current
  • Successfully led new team On-Shore by training them in PySpark and then brought application offsite from sub contractors in France.
  • Seamlessly migrated slow running reports into fast paced one using PySpark in back-end.
  • Learnt tools like Version One and Service Now in no time to deal with User stories and Incidents, respectively.
  • Successfully implemented foreign Data Ingestion tools to bring data to our Data Lake(Foundry) successfully.
  • Vast experience in end to end implementation and setup of application using PySpark and Spark SQL.
  • Crafted the monitoring dashboard which gave real time updates of our datasets, removing the previous manual monitoring activity from 30 minutes to < 5 minutes.
  • Successfully led a data engineering team to resolved problems, improve operations and provided exceptional service.
  • Successfully completed a POC of my current project architecture using Azure Data Factory and Azure Databricks

Consultant

Capgemini
09.2017 - 10.2019
  • Quickly understood and migrated almost 50 old transformation codes written in 'Mesa' language(Local to Foundry Tool) into PySpark and Spark SQL scripts.
  • Excelled in front End Development using java scripts and HTML (not core competency).
  • Worked as SAP BW Consultant to perform support activities such as incident management and gave almost 10 trainings related to SAP BW and setup of daily monitoring in 6 months.

SAP BW Consultant

Accenture
08.2013 - 09.2017
  • Learnt art of monitoring Daily Batch with immediate alerting and fixed various bugs such as extraction failures, data failures and BWA Roll-up issues, etc.
  • Patented solution by using APD's to fill info package filter for selective extraction, bringing down activity time from 1 week to just a mouse click.
  • Worked rigorously on more than 100 incidents and new developments in SAP BW on support project.
  • Single-Handedly fixed major finance issue in a report by increasing packet size of data sent by BWA to SAP BO, saving ~1000 USD.
  • Communicated and explained business requirements to team members to understand and implement functional demands.

Education

B-Tech -

KIIT University
Bhubaneswar
07.2013

Skills

  • PySpark
  • Spark SQL
  • Spark Structured Streaming
  • Apache Kafka
  • Big Data
  • Azure Data Factory
  • Azure Databricks
  • Data Warehousing
  • SAP BW

Certification

Databricks Associate Developer for Apache Spark 3.0 (Python)

Hobbies and Interests

Composing Music

Timeline

Lead Data Engineer

Airbus
11.2019 - Current

Consultant

Capgemini
09.2017 - 10.2019

SAP BW Consultant

Accenture
08.2013 - 09.2017

B-Tech -

KIIT University

Similar Profiles

CREATE PROFILE
Rohit Jha