Thretheswar Reddy
Data Engineer
Bengaluru
Summary
Experienced Software Professional with 8 years of expertise in GCP, AWS, Terraform, Jenkins, and Data Engineering related technologies. Proven ability to design and implement scalable cloud infrastructure solutions, automate deployment processes and optimize software development workflows. Known for strong collaborative skills and ability to adapt to dynamic project requirements, delivering reliable and timely solutions.
Overview
9
9
years of professional experience
Work History
Data Engineer
Newscorp India
07.2023 - Current
- Optimized cloud maintainability by automating Google Cloud infrastructure through Terraform, GitHub, and CircleCI, establishing robust IaC standards across the environment.
- Developed CI/CD pipelines for deploying DAGs, cloud functions, and Dataform workflows.
- Developed a comprehensive end-to-end framework for regular Cloud Composer upgrades.
- Deployed a New Relic monitoring solution for BigQuery to track system health, optimize resource consumption, and automate performance alerting.
- Optimized local Airflow development with Docker, simplifying the configuration, and enabling swift, end-to-end pipeline validation.
- Developed and enhanced custom airflow operators to handle unique data requirements.
- Collaborated with cross-functional teams to build automated GCP and platform tooling, significantly boosting productivity and eliminating manual errors.
- Worked on PoCs exploring Data fusion for building pipelines and Data flow for compression and migration of GCS data.
DevOps Engineer
RDP Workstations Pvt. Ltd.
07.2017 - 06.2023
- Monitored automated build and continuous software integration process to drive build/release failure resolution using Jenkins.
- Worked with cross-functional design teams to create software solutions that improved overall functionality and performance.
- Worked with software development and testing team members to design and develop robust solutions to meet the requirements for functionality, scalability, and performance.
- Supported development teams by building maintainable and scalable infrastructure using IaC tools (Terraform) and best practices.
- Optimized parallel development of applications using the Gitflow branching strategy.
- Worked on automating manual, repetitive tasks.
- Built and packaged a Java-based application using Maven.
- Deployed Java-based applications on Tomcat web servers.
- Built lightweight Docker images using multistage builds.
- Used Jenkins pipelines to continuously integrate the code changes and deploy containerized microservices on the AWS EKS cluster.
- Designed and developed solutions in the cloud for various applications using AWS services: Lambda, CloudWatch, STS, VPC, ELB, ASG, and Route 53.
Education
Bachelor of Technology - Mechanical Engineering
Indian Institute of Technology - Madras
Chennai, India06-2017
Skills
Linux and Shell Scripting
Python, SQL and PySpark
Jenkins and CircleCI
Docker and Kubernetes
SQL
Timeline
Data Engineer
Newscorp India
07.2023 - Current
DevOps Engineer
RDP Workstations Pvt. Ltd.
07.2017 - 06.2023
Bachelor of Technology - Mechanical Engineering
Indian Institute of Technology - Madras