Summary
Overview
Work History
Education
Skills
Accomplishments
Languages
Timeline
Generic

PRIYANKU MEDHI

Bangalore

Summary

Dynamic Senior Data Engineer with a proven track record at GE Healthcare, specializing in ETL development and data migration. Good hands on in Python and AWS services, I enhanced processing reliability and reduced costs by 40%. A collaborative leader, I thrive on optimizing data workflows and driving impactful results in fast-paced environments.

Overview

10
10
years of professional experience

Work History

Bangalore

GE Healthcare
Bangalore
08.2019 - Current
  • Project: Direct Ingestion Servicesuite.
  • Spearheaded development of ETL pipeline, generating ~$20K in monthly revenue.
  • Built automated snapshot process for over 1,000 tables in Amazon Redshift.
  • Integrated AWS Step Functions, Lambda, and Matillion for efficient workflow orchestration.
  • Project: Compaction Framework Servicesuite.
  • Designed and implemented compaction framework for CRM data migration to AWS.
  • Embedded slowly changing dimension SDC logic using AWS Glue for historical data tracking.
  • Established scalable data workflows, enhancing processing reliability.
  • Reduced Glue costs from $20K to $12K per month through optimized ETL solutions.

Data Engineer

Cluster Foundry
Bangalore
09.2018 - 08.2019
  • Project : Insurance Revenue Model Migration
  • Optimized ETL workflows for sales and marketing analytics to enhance data processing efficiency.
  • Achieved a 40% increase in pipeline performance by refactoring Spark and SQL code.
  • Migrated legacy SQL transformations to PySpark, resulting in improved scalability of data processes.

Data Engineer

Zaloni Technologies
Guwahati
08.2015 - 07.2018
  • Project: IRi (ETL Offload)
  • Automated data pipelines using Python, Hive, and Hadoop.
  • Migrated legacy workloads to Hadoop, and applied Apache Ranger for data security.
  • Designed robust validation strategies for full and incremental data loads.
  • Project: Du Telecom.
  • Ingested and processed data securely, performed KPI processing, and stored results in Hive tables.
  • Build a robust framework for the validation of data.
  • Other Projects
  • Magellan: Hadoop, Hive, Sqoop
  • Etihad Airways: Hadoop, PySpark, Hive

Education

Bachelor of Engineering -

Jorhat Engineering College
06-2015

Skills

  • Cloud technologies: AWS (S3, Redshift, Glue, Step Function, Lambda, CloudWatch)
  • Big data frameworks: Apache Spark, Hive, Hadoop
  • ETL tools: Matillion, Apache Ranger
  • Agile methodology and OOP principles
  • Data warehousing and analytics
  • Team leadership and collaboration
  • Programming languages: Python, Shell script, SQL
  • Databases: PostgreSQL, MySQL

Accomplishments

  • Award regarding successful completion of migration of Greenplum system to AWS
  • Award for reducing the effort for successful migration of the older CICD pipeline to the newer CICD pipeline in 40 hrs

Languages

English
First Language

Timeline

Bangalore

GE Healthcare
08.2019 - Current

Data Engineer

Cluster Foundry
09.2018 - 08.2019

Data Engineer

Zaloni Technologies
08.2015 - 07.2018

Bachelor of Engineering -

Jorhat Engineering College
PRIYANKU MEDHI