Summary
Overview
Work History
Education
Skills
Websites
Technical Experience
Disclaimer
Software
Timeline
Generic

Challa Jagadeeswara Reddy

Senior Data Engineer
Tirupati

Summary

Experienced IT professional with 6.2 years in software development and implementations, specializing as a Data Engineer for 4.2 years and Python Developer for 2 years. Proficient in technologies within the Hadoop Ecosystem including Blob, ADLS GEN2, HDFS, Hive, MapReduce, Sqoop, and Python Spark. Strong knowledge of AWS services such as S3, EC2, Glue, Athena, Lambda Functions, EMR, and CloudWatch. Skilled in Python and experienced with Iceberg, Jenkins, Azure Data Factory, Delta Lake, Azure Blob Storage, ADLS, and Azure Data Bricks; adept at writing complex queries using Hive analytical functions and proficient in project tracking with tools like Jira and code management using GitHub.

Overview

7
7
years of professional experience
4
4
Languages

Work History

Data Engineer

Pinaki Soft Con Private Limited
08.2024 - 02.2025
  • Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
  • Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
  • Automated routine tasks using Python scripts, increasing team productivity and reducing manual errors.
  • Worked on AWS, ATHENA,LAMDA,REDSHIFT,S3, SCREAT MANAGER,CLOUDWATCH,GLUE, AIRFLOW, CTRL-M , DBEVER, SQL,PYTHON,PYSPARK.


Sr. Data Engineer

Horizontal Integration India Pvt Ltd
02.2023 - 03.2024
  • Ensured data quality through rigorous testing, validation, and monitoring of all data assets, minimizing inaccuracies and inconsistencies.
  • Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.
  • Migrated legacy systems to modern big-data technologies, improving performance and scalability while minimizing business disruption.
  • Automated routine tasks using Python scripts, increasing team productivity and reducing manual errors.
  • Led end-to-end implementation of multiple high-impact projects from requirements gathering through deployment and post-launch support stages.
  • WORKED ON PYTHON, PYSPARK, GCP,AWS, POSTGRESS, DATALAKE, AIRFLOW,INFLUX DB, GRAFANA.

Sr. Data Engineer

Virtusa
11.2022 - 02.2023
  • Enhanced data quality by developing robust validation strategies to identify and correct inconsistencies.
  • Automated routine tasks through scripting languages, reducing manual effort and human error risks.
  • WORKED ON PYTHON , PYSPARK, HADOOP,HIVE,AIRFLOW,POSTGRESS,AWS,snowflake

Data Engineer

Infosavant Technologies
08.2018 - 10.2022
  • Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
  • Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
  • Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
  • Automated routine tasks using Python scripts, increasing team productivity and reducing manual errors.

Education

MBA - Financial Analysis

KSRM College of Management Studies
Kadapa, India
04.2001 -

Skills

HDFS

HIVE

PYSPARK

SQL

PYTHON

SPARK

API

ICEBURG

LINUX

POSTGRESQL SERVER

ADF

ADL GEN2

BLOB STORAGE

AWS EMR

EC2

S3

undefined

Technical Experience

HDFS, HIVE, PYSPARK, SQL, PYTHON, SPARK, API, ICEBURG, PYTHON, LINUX, POSTGRESQL SERVER, ADF, ADL GEN2, BLOB STORAGE, AWS EMR, EC2, S3, GLUE, LAMBDA, DBT, JIRA, GitHub, PYCHARM, GRAFANA, VS CODE

Disclaimer

I hereby certify that all the information provided above is true to the best of my knowledge.

Software

Python

Pyspark

Sql

Airflow

AWS

Timeline

Data Engineer

Pinaki Soft Con Private Limited
08.2024 - 02.2025

Sr. Data Engineer

Horizontal Integration India Pvt Ltd
02.2023 - 03.2024

Sr. Data Engineer

Virtusa
11.2022 - 02.2023

Data Engineer

Infosavant Technologies
08.2018 - 10.2022

MBA - Financial Analysis

KSRM College of Management Studies
04.2001 -

Similar Profiles

CREATE PROFILE
Challa Jagadeeswara ReddySenior Data Engineer