Patnala Rajesh Kumar Reddy
Visakhapatnam,AP
Summary
Throughout my 3.4 years of experience in Data Engineering Field, I worked on various projects, and technologies I always contributed my best in deliverables, re-skilling on different skills. Analytical skill is always my top skill and I thrive to improve it. My Interest on data related fields started from BigData and it engages me in different challenges because the data is unpredictable.
Overview
4
4
years of post-secondary education
Work History
Data Engineer - Big Data
Infosys
- Created python scripts to ingest data from various 10 diverse sources to Hadoop, Hive, and vice-versa using spark, sqoop
- Provided Solution to client ingest data to S3 using AWS CLI commands instead of distcp
- Designed and Implemented python scripts to migrate data to AWS S3 and vice-versa which improved uploading, downloading speed by 55%
- Led a team of 3 full-time employees on the migrating TB's of data from Hadoop to S3 using python parallel processing scripts by an average of 5 TB/day
- Implemented Parallel Processing in scripts which increased the data ingestion performance by 30%.
Data Engineer - ETL
Infosys
- Worked on POC for Data Ingestion Solution using Talend and delivered to Client
- Created and Maintained Talend Artifacts for ingesting data from different sources to S3 and vice-versa which is 60% faster than Client existing ingestion process
- Optimized Java code for data transformations which resulted in performance improvement of 98%
- Created Glue Jobs for File Formats Conversions which helped in reducing conversion time by 80%
- Implemented Terraform code to manage AWS infrastructure and deploying the scripts to AWS which reduced manual effort by 75%
Data Engineer - Python
Infosys
- Explore and analyze raw datasets available from year 1900 from official bodies websites.
- Created python scripts using pandas, numpy modules to clean the raw datasets
- Transform the raw datasets into Cleaned CSV files and upload the final files to datacommons.org site.
Education
Bachelor of Science - Electronics And Communication
Raghu Engineering College
09.2014 - 04.2018
Skills
TalendSQL, NoSQL(MongoDB)
Spark, BigData, Shell Scripting
AWS (Glue, Lambda, S3), Terraform
Timeline
Bachelor of Science - Electronics And Communication
Raghu Engineering College
09.2014 - 04.2018
Data Engineer - Big Data
Infosys
Data Engineer - ETL
Infosys
Data Engineer - Python
Infosys