A Data Inspired Engineer holding 3+ years of experience in building robust data pipelines and implementing complex ETL processes that enable organizations to extract incredible value from their data.
Adept at collaborating with data scientists, analysts, and other stakeholders to understand their data needs and translate them into scalable solutions.
Highly skilled in Big Data Analytics solution.
Overview
5
5
years of professional experience
4
4
years of post-secondary education
Work History
Data Engineer
SAP Labs India Pvt. Ltd.
Bangalore
11.2021 - Current
Developing scalable data pipelines for data extraction, clean, preprocess, and to transform using Big data technologies.
Developing data pipelines that consume both batch & streaming data (using Kafka and Airflow) to deliver overall program performance and actionable loyalty insights.
Working on ETL tasks, maintaining data integrity and verifying pipeline stability.
Developed several ETL data pipelines using Spark and Hadoop, from architecture till development.
Hands on Experience in Hadoop ecosystem including Apache Spark, Spark Streaming,Spark SQL, Hive, Sqoop, Hbase, Kafka and Airflow.
Associate Data Engineer
SAP Labs India Pvt.Ltd.
Bangalore
11.2020 - 10.2021
Implemented Spark jobs by utilizing data frames and Spark SQL API for faster data processing.
Worked with SQOOP to load input data from multiple source to HDFS.
Created and worked on Sqoop jobs with incremental load to extract the data in an incremental last modified mode to HDFS to optimize performance.
Performed data processing such as aggregation, join, filter as per business rule.
Implementation of Partition, bucketing and various optimization techniques in Hive. Designed and modeled both managed and external tables in Hive.
Associate Software Engineer
Accenture India Pvt. Ltd.
Bangalore
08.2018 - 10.2020
Created Hive Tables, loading data and writing Hive queries.
Worked on importing and exporting data from Relational databases to HDFS and Hive using sqoop.
Developed SAP FIORI Applications in SAP HCM based on REST APIs and ABAP on HANA Concepts like code push down, OOABAP, SAPUI5, CDS Views and AMDP.
Built ODATA based SAP applications and enriched the user experience through SAPUI5 breakouts, provided side-by-side and in-app extensibility, performance optimizations, unit testing and documenting technical solutions.
Education
Bachelor of Engineering - Electrical And Electronics Engineering
SRM Valliammai Engineering College
Chennai,Tamilnadu
07.2014 - 05.2018
Skills
Big Data Technologies: Sqoop,Hive,Hbase,Kafka,Scala,Apache Spark,Airflow
undefined
Accomplishments
Awarded "Innovator of the Season 2022" for my contributions at SAP
Awarded "All rounder of the Season 2021" at SAP
Awarded "Spot Award" under early talent's Category at SAP
Awarded "Growth Catalyst 2019" for my Outstanding Performance at Accenture
Timeline
Data Engineer
SAP Labs India Pvt. Ltd.
11.2021 - Current
Associate Data Engineer
SAP Labs India Pvt.Ltd.
11.2020 - 10.2021
Associate Software Engineer
Accenture India Pvt. Ltd.
08.2018 - 10.2020
Bachelor of Engineering - Electrical And Electronics Engineering