RAHUL GUPTA
Bengaluru
Summary
Azure Data Engineer with over 9 years of experience in data transformation, automation, and cloud migration. Proficient in Azure Data Factory, PySpark, Databricks, ADLS, and Synapse Analytics. Skilled in building scalable data pipelines and leading enterprise data solutions. Strong focus on performance tuning, data governance, and business-driven analytics.
Overview
9
9
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
Maersk Global Services India Pvt. Ltd.
Bengaluru
07.2021 - Current
- Project - Compliance & Governance
- Project Description - To implement an automated compliance and governance framework ensuring regulatory adherence and data integrity across shipping operations. The goal was to enhance audit readiness, reduce compliance risks, and enforce consistent data policies globally.
- Tools - PySpark, Azure Data Factory, ADLS Gen2, Azure Databricks, Logic Apps, Power BI
Senior Consultant
Ubiquie Systems Pvt. Ltd. (Deputed at Maersk)
Pune
01.2021 - 07.2021
- Project - Simplified Invoicing
- Description - Automated surcharge application in the invoicing process, eliminating manual intervention for services availed by Maersk customers. Built data pipelines using PySpark and ADF, with data stored in ADLS Gen2 and processed via Azure Databricks. Utilized Logic Apps for workflow orchestration.
- Tools - PySpark, Azure Data Factory, ADLS Gen2, Azure Databricks, Logic Apps
Big Data & Cloud Senior Developer
Azbooba India Infotech Pvt. Ltd.
Pune
10.2019 - 01.2021
- Project - AHOLD, US – Blade
- Description - Migrated HR data from multiple sources to Azure Data Lake Storage Gen2, transforming it into a normalized format for reporting. Developed ETL pipelines using PySpark and ADF, and leveraged Azure Databricks for data processing. Integrated Synapse Analytics for reporting and Logic Apps for workflow automation.
- Tools - PySpark, ADF, ADLS Gen2, Azure Databricks, Logic Apps, Synapse Analytics
Software Engineer
L&T Infotech
Pune
12.2018 - 10.2019
- Project - OTIS, US – Global BI Project
- Description - Migrated legacy SAP BODS ETL scripts to Spark-based data pipelines using PySpark on Azure Databricks. Implemented data transformations with ADF and stored processed data in ADLS Gen2 and Azure SQL Data Warehouse.
- Tools - PySpark, ADF, ADLS Gen2, Azure Databricks, Logic Apps, Azure SQL Data Warehouse
Systems Engineer
Tata Consultancy Services
Chennai
06.2016 - 12.2018
- Project - Citibank, US – Genesis Retail Project
- Description - Built a data platform to process customer transaction data and generate business-critical reports, enabling insights to improve retail banking services. Utilized PySpark for data transformation and Hive for querying, with workflow orchestration via Oozie on Cloudera.
- Tools - PySpark, HDFS, Hive, Sqoop, Oozie, Cloudera
Education
Bachelor of Technology - Computer Science
SRM University
Chennai06-2016
HSC -
City Montessori School
Lucknow05-2012
SSC -
City Montessori School
Lucknow05-2010
Skills
- PySpark
- Python
- Azure Data Factory
- Azure Databricks
- ADLS Gen2
- Logic Apps
- Power BI
- Synapse Analytics
- SQL
- Git
LANGUAGES
English
Hobbies and Interests
Traveling, Watching web series
Certification
DP-203 (Microsoft Azure Data Engineer)
Timeline
Senior Data Engineer
Maersk Global Services India Pvt. Ltd.
07.2021 - Current
Senior Consultant
Ubiquie Systems Pvt. Ltd. (Deputed at Maersk)
01.2021 - 07.2021
Big Data & Cloud Senior Developer
Azbooba India Infotech Pvt. Ltd.
10.2019 - 01.2021
Software Engineer
L&T Infotech
12.2018 - 10.2019
Systems Engineer
Tata Consultancy Services
06.2016 - 12.2018
Bachelor of Technology - Computer Science
SRM University
HSC -
City Montessori School
SSC -
City Montessori School