Summary
Overview
Work History
Education
Skills
Certification
Accomplishments
Websites
Languages
Timeline
Generic
Prathippa Devi

Prathippa Devi

Ingolstadt

Summary

As a Microsoft certified data engineer/ETL developer with 6 years of experience, I have worked on various projects and have a good grasp of data engineering concepts such as data extraction and transformation. I am proficient in writing PySpark/Python scripts and have experience in development and implementation in the area of Azure Cloud. I am also adaptive to learning new technology.

Overview

7
7
years of professional experience
1
1
Certification

Work History

Data Engineer

IBM
07.2022 - Current
  • Design end-to-end ETL pipelines for data ingestion and transformation from various sources like APIs, on-premises SAP, Salesforce tables into Snowflake, Azure cloud data warehouse along with implementation of SCD type 2 .
  • Collaborated with team of data architects and cross-functional teams to understand business requirements and develop data-driven solutions.
  • Designed automation (sending reminder email)using IBM Watson Orchestrate for client business needs.
  • Took leadership in my team, strategized the concept of automating the manual process of logic app and service bus creation using python scripts and reduced 30% of development cost.
  • Responsible for enhancing the existing pipeline and migrating Informatica Workflow to Azure pipelines.
  • Handled Big data with high velocity of data ingestion, production support, check data quality of incoming file arrivals.

Associate Consultant/Data Engineer

KPMG
03.2021 - 07.2022
  • Designed a project model to store/compute calculations of numerical data on the back end using mathematical approach and optimized the execution time by 20% .
  • Transforming MS EXCEL power queries to python/pyspark scripts for data transformation and calculations.
  • Tested frontend & backend functionality of developed data quality UI tool.
  • Written scripts for data loading, manipulation using PySpark, Python, Pandas, and SQL.
  • Worked with different structured and semi-structured data formats like CSV, XML, JSON.
  • Automate manual processes and enhance data pipelines.
    Used Git Repository, Build and Deploy (CI/CD) pipelines in DevOps using YAML file.

Business Analyst

Exl Services
12.2018 - 03.2021
  • Written python scripts for creating an internal data quality tool.
  • Exposure on Metadata driven ETL Framework implemented in Azure Data Lake.
  • Extensively worked on Azure Databricks and developed Notebooks on all aspects of Data Loading, Data Transformation and Auditing.
  • Worked in agile methodologies (KANBAN).

Graduate Trainee

Bias Info Tech(acquired By Deloitte)
10.2016 - 05.2018
  • Developed SQL store procedure and implemented the business logic.
  • Worked on raw data analysis and data modelling in Erwin tool.
  • Assisting Oracle DBA tasks and solving P3 tickets.

Education

Master of Science - Artificial Intelligence

Liverpool John Moore
United Kingdom

Bachelor's of Engineering - Computer Science

Anna University
India

Skills

  • Microsoft Azure Cloud - Azure Fabric Databricks Azure Synapse Analytics Azure Data Lake Storage Azure Data Factory Function App Logic app DevOps Azure Stream Analytics Azure EventHub
  • Amazon Web Services(AWS) Cloud - S3 Lambda SQS
  • Programming Language: Python (Pandas Numpy) SQL
  • Big Data Processing: Apache Spark
  • Data Integration: ETL pipelines Data Transformation Data Warehousing
  • Deployment: Git GitHub CI/CD
  • Data Visualization : Power BI
  • Apache Airflow Scrum Agile

Certification

DP-203: Microsoft Azure Data Engineer Associate

Accomplishments

Shining Star of the quarter(Q4) 2019.

Websites

Languages

English
Advanced (C1)
German
Elementary (A2)

Timeline

Data Engineer

IBM
07.2022 - Current

Associate Consultant/Data Engineer

KPMG
03.2021 - 07.2022

Business Analyst

Exl Services
12.2018 - 03.2021

Graduate Trainee

Bias Info Tech(acquired By Deloitte)
10.2016 - 05.2018

Master of Science - Artificial Intelligence

Liverpool John Moore

Bachelor's of Engineering - Computer Science

Anna University

Similar Profiles

CREATE PROFILE
Prathippa Devi