Summary
Overview
Work History
Education
Skills
Interests
Timeline
ResearchAssistant
VARAGINI KARTHIK

VARAGINI KARTHIK

Product Development Engineer III
Hyderabad

Summary

Accomplished Data Engineer with 12 years of experience in designing and implementing high-performance data pipelines. Proficient in leveraging a comprehensive tech stack that includes Python, Java, Apache Flink, Hudi, Iceberg, Airflow, Pinot, and Superset to efficiently extract, transform, load, and serve large datasets. Demonstrated ability to deliver significant cost reductions through optimized data pipelines and real-time analytics solutions. Experienced in managing and querying data using SQL Server, Redshift, PostgreSQL, MySQL, and Snowflake. Adept at working with cloud platforms such as AWS and Azure, with a strong background in Finance, Healthcare, Advertising, and CRM domains.

Overview

13
13
years of professional experience
3
3
years of post-secondary education

Work History

Product Development Engineer III

Phenom People Pvt Ltd
Hyderabad
03.2021 - Current
  • Designed and implemented complex data pipelines using a robust tech stack including Python, Pinot, Superset, Flink, Apache Hudi, Apache Iceberg, AWS Neptune DB, Apache Airflow, Apache Atlas, and data lineage. Demonstrated proficiency in POC execution for emerging technologies to drive innovation.
  • Successfully migrated large-scale data to Apache Hudi, optimizing data management and processing efficiency. Leveraged Hudi's capabilities for improved query performance, reduced storage costs, and enhanced data accessibility.
  • In order to decrease transformation time on data came up with ELT (Extract Load and Transform) approach.
  • Developed pipeline using Atlas Mapping to avoid building new ETL pipelines for each customers.
  • Created pipeline to allow 900M records to receive NRT updates through Flink.
  • Metrics were extracted from larger set of data by integrating Apache Pinot and Superset, by using this approach lot of infrastructure and manual effort was reduced.

Senior Development Engineer

Pramati Technologies
Hyderabad
12.2017 - 03.2021
  • Managed Data Mapping team to build ETL. Gone through EHR data of NextGen, EyeMed, MedFlow to do mapping with common model for IRIS Registry. Generated MIPS reports
  • Build ETL pipeline using Python, Airflow for Health care client.
  • Involved in product development for customers using MVC, Python, Kubernetes, Helm.
  • Developed framework to support Dynamic workflows.
  • Worked on Airlines related project to implement dynamic seats allocation.

Senior Technical Associate

Evoke Technologies
Hyderabad
03.2016 - 12.2017
  • Developed applications on MVC, Web API’s, ASPNET Core.
  • Worked on the Retail webpages to support the catalog functionality.

Senior Software Engineer

Lycos Internet Ltd
Hyderabad
09.2014 - 03.2016
  • Developed applications on Asp.Net, MVC, Web API’s.

Senior Software Engineer

Persistent Systems
Hyderabad
09.2011 - 09.2014
  • Developed applications on Asp.Net
  • Cox Digital Solutions enables the publishers to offer standard ad solutions that go beyond standard banners ads. It supports rich text, image, flash and video ads.
  • This website provides its customers to upload and display their ads on different websites. It has different revenue models based on clicks and impressions.

Education

Computer Application

Vignan Institute of Information And Technologies
Visakapatnam
08.2008 - 07.2011

Skills

Python, Airflow,Graph DB, Apache Hudi, Iceberg

undefined

Interests

Cricket

Dancing

Timeline

Product Development Engineer III

Phenom People Pvt Ltd
03.2021 - Current

Senior Development Engineer

Pramati Technologies
12.2017 - 03.2021

Senior Technical Associate

Evoke Technologies
03.2016 - 12.2017

Senior Software Engineer

Lycos Internet Ltd
09.2014 - 03.2016

Senior Software Engineer

Persistent Systems
09.2011 - 09.2014

Computer Application

Vignan Institute of Information And Technologies
08.2008 - 07.2011

Similar Profiles

CREATE PROFILE
VARAGINI KARTHIKProduct Development Engineer III