PRIYANKU MEDHI
Bangalore
Summary
Dynamic Senior Data Engineer with a proven track record at GE Healthcare, specializing in ETL development and data migration. Good hands on in Python and AWS services, I enhanced processing reliability and reduced costs by 40%. A collaborative leader, I thrive on optimizing data workflows and driving impactful results in fast-paced environments.
Overview
10
10
years of professional experience
Work History
Bangalore
GE Healthcare
Bangalore
08.2019 - Current
- Project: Direct Ingestion Servicesuite.
- Spearheaded development of ETL pipeline, generating ~$20K in monthly revenue.
- Built automated snapshot process for over 1,000 tables in Amazon Redshift.
- Integrated AWS Step Functions, Lambda, and Matillion for efficient workflow orchestration.
- Project: Compaction Framework Servicesuite.
- Designed and implemented compaction framework for CRM data migration to AWS.
- Embedded slowly changing dimension SDC logic using AWS Glue for historical data tracking.
- Established scalable data workflows, enhancing processing reliability.
- Reduced Glue costs from $20K to $12K per month through optimized ETL solutions.
Data Engineer
Cluster Foundry
Bangalore
09.2018 - 08.2019
- Project : Insurance Revenue Model Migration
- Optimized ETL workflows for sales and marketing analytics to enhance data processing efficiency.
- Achieved a 40% increase in pipeline performance by refactoring Spark and SQL code.
- Migrated legacy SQL transformations to PySpark, resulting in improved scalability of data processes.
Data Engineer
Zaloni Technologies
Guwahati
08.2015 - 07.2018
- Project: IRi (ETL Offload)
- Automated data pipelines using Python, Hive, and Hadoop.
- Migrated legacy workloads to Hadoop, and applied Apache Ranger for data security.
- Designed robust validation strategies for full and incremental data loads.
- Project: Du Telecom.
- Ingested and processed data securely, performed KPI processing, and stored results in Hive tables.
- Build a robust framework for the validation of data.
- Other Projects
- Magellan: Hadoop, Hive, Sqoop
- Etihad Airways: Hadoop, PySpark, Hive
Education
Bachelor of Engineering -
Jorhat Engineering College
06-2015
Skills
- Cloud technologies: AWS (S3, Redshift, Glue, Step Function, Lambda, CloudWatch)
- Big data frameworks: Apache Spark, Hive, Hadoop
- ETL tools: Matillion, Apache Ranger
- Agile methodology and OOP principles
- Data warehousing and analytics
- Team leadership and collaboration
- Programming languages: Python, Shell script, SQL
- Databases: PostgreSQL, MySQL
Accomplishments
- Award regarding successful completion of migration of Greenplum system to AWS
- Award for reducing the effort for successful migration of the older CICD pipeline to the newer CICD pipeline in 40 hrs
Languages
English
First Language
Timeline
Bangalore
GE Healthcare
08.2019 - Current
Data Engineer
Cluster Foundry
09.2018 - 08.2019
Data Engineer
Zaloni Technologies
08.2015 - 07.2018
Bachelor of Engineering -
Jorhat Engineering College
Similar Profiles
Khoa NguyenKhoa Nguyen
Customs Operational Leader at GE Power, GE Healthcare, GE RenewableCustoms Operational Leader at GE Power, GE Healthcare, GE Renewable
Germán HernándezGermán Hernández
Services Operations Leader - LATAM at GE HealthcareServices Operations Leader - LATAM at GE Healthcare
Elijah DeLeonElijah DeLeon
Manufacturing Associate at GE HealthcareManufacturing Associate at GE Healthcare
A LeeA Lee
Production Associate at GE HealthcareProduction Associate at GE Healthcare
Simran SSimran S
Travel Consultant at BCD TravelTravel Consultant at BCD Travel