Summary
Overview
Work History
Education
Skills
Accomplishments
Affiliations
Timeline
Generic

Divakar Reddy Lingala

Hyderabad

Summary

Senior Data Engineer with nearly 8 years of experience in developing and optimizing data pipelines and infrastructure. Responsible for Design and implementation of the solutions for the new product launches and data associated problems in the organization. Effective in setting up both Batch and streaming data pipelines for processing different types of files. Proficient in a variety of programming languages and technologies, including Python, SQL, Big-Query, PostgreSQL, GCP, Kubernetes, Docker, Pub-sub and Kafka.

Overview

8
8
years of professional experience

Work History

Senior Data Engineer

APREE HEALTH
Sattva Knowledge Park, Hyderabad
11.2021 - Current
  • Migrated Data pipelines (ETL Jobs ) to the GCP.
  • Providing solutions for the technical problems , designing the solutions and implementing them.
  • Implemented Multi statement transactions in Big Query using the Sessions.
  • Developed streaming Data pipelines in GCP using Python, SQL, Big-query, Docker, Kubernetes, Pub-sub, GCS.
  • Developed batch Data pipelines in GCP using Docker, Airflow, GCS, Pub-sub, Kubernetes.
  • Developed the CDC (Change Data Capture) jobs to sync the Data to Down streams.
  • Building Cron Jobs to integrate data from the other teams and sources using Kafka.
  • Built a Common File Framework to Load different files types to respective Table schema.
  • Built a common Validation frame work for the data pipelines to validate the data.
  • Built many Automation scripts and tools for the Support team to resolve the customer issues.
  • Developed streaming Data pipelines using Kafka , python , Big-query, Docker and Kubernetes.
  • Providing backend support for the python web-application.
  • Setting up the infrastructure in GCP using the Terraform .

Data Engineer /Python Developer

HYUNDAI
Hyderabad
08.2016 - 11.2021
  • Worked as Backend developer using Python ,SQL .
  • Creating and maintaining technical documentation.
  • Writing and optimizing SQL queries and stored procedures.
  • Developed ETL pipeline to process CSV,PSV , XLS files using Python, Mysql and Pandas.
  • Troubleshoot and debug the production issues to identify the root cause and provide the fix.
  • Python scripting to automate the process.
  • Writing the Backend API's to integrate into other applications.
  • Set up automation scripts & cron jobs to generate the reports

Education

Bachelor of Engineering Technology - Mechanical Engineering

G Pulla Reddy Engineering College (GPREC)
Kurnool, India
05-2016

Intermediate - MPC

Sri Chaitanya Junior College
Vijayawada
05-2012

High School Diploma -

ZPHS Boys Highschool
Bukkapatnam
04-2010

Skills

Python, GCP, MySQL, Big-Query, PostgreSQL, Kafka, Docker, Kubernetes, Pub-sub, GCS, Air Flow, Terraform

Accomplishments

Apree Best Performer of the Quarter:

Q2 2023 & Q3 2023

Affiliations

  • Playing Cricket
  • Long rides on bike

Timeline

Senior Data Engineer

APREE HEALTH
11.2021 - Current

Data Engineer /Python Developer

HYUNDAI
08.2016 - 11.2021

Bachelor of Engineering Technology - Mechanical Engineering

G Pulla Reddy Engineering College (GPREC)

Intermediate - MPC

Sri Chaitanya Junior College

High School Diploma -

ZPHS Boys Highschool

Similar Profiles

CREATE PROFILE
Divakar Reddy Lingala