Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic
Arun Reddy

Arun Reddy

Senior Platform Engineer
Hyderabad

Summary

Impact-driven Platform Engineer with 5 years of experience designing and deploying scalable infrastructure, MLOps pipelines, and GenAI systems across cloud-native environments. Specialized in ML model lifecycle management, GenAI/LLM deployments, and edge-to-cloud integration. Proven expertise in tools like MLFlow, VertexAI Pipelines, Kubeflow, Triton Inference Server, and NVIDIA Riva & Tokkio. Proficient at orchestrating GPU-backed inference services on Kubernetes, automating CI/CD workflows, and driving performance and cost optimization in both development and production-scale environments.

Overview

5
5
years of professional experience

Work History

Senior Platform Engineer

Quantiphi Analytics
Bengaluru
08.2021 - Current
  • Developed and deployed IoT and machine learning solutions and implemented microservices architecture for Kubernetes clusters and reducing deployment time by 25%.
  • Automated the configuration of cloud infrastructure and provisioning utilizing Terraform, streamlined CI/CD pipeline maintenance, and enhanced edge device onboarding processes, improving deployment efficacy by 40%.
  • Designed and deployed MLOps pipelines integrating MLFlow, Kubeflow, and GCP VertexAI for scalable model training, tuning, and deployment workflows.
  • Built and maintained GPU-backed model serving infrastructure using NVIDIA Triton and VLLM frameworks on Kubernetes clusters.
  • Deployed and managed LLM and speech-based GenAI systems, including TTS and ASR models (NVIDIA Riva) for conversational AI and digital avatar use-cases.
  • Led the deployment of NVIDIA Tokkio pipelines for Digital Avatar services on Kubernetes, ensuring real-time inference and low-latency interaction.
  • Engineered and implemented robust, scalable infrastructure architectures with a focus on fault tolerance, utilizing advanced cloud platforms such as AWS and Oracle Cloud Infrastructure (OCI).
  • Achieved a 30% reduction in cloud expenses through strategic optimizations.
  • Engineered secure data transmission pipelines between local devices and AWS IoT services, ensuring seamless communication.
  • Maintained rigorous security compliance and implemented patch management protocols.
  • Engaged collaboratively with stakeholders while mentoring team members in DevOps technologies, and led the execution of cloud platform solutions and infrastructure automation initiatives.

Cloud SysOps Associate

CyberNX Technologies
Mumbai
09.2020 - 08.2021
  • Implemented AWS EKS clusters for microservice environments, enhancing traffic management efficiency via host-based routing with ALB and Route53 integration.
  • Created golden templates for Linux servers and managed cloud networks and Instances, Automated server hardening and configuration which reduced configuration time
  • Created Docker containers and corresponding Dockerfiles with Amazon ECR; deployed Kubernetes workloads leveraging Helm charts and network policies.
  • Administered Kubernetes ecosystem utilizing service accounts and detailed RBAC (Role-Based Access Control) protocols, reducing access violations by 70%
  • Assisted in monitoring and incident response setup using Prometheus and Grafana for cloud-native systems.

Education

B.Tech - Computer Science

CMR Institute of Technology
Hyderabad

Skills

  • Cloud & Infrastructure: AWS, GCP, OCI, Edge devices(IoT)
  • Container orchestration: Kubernetes, Docker, Docker-Compose
  • CI/CD & Automation: GitHub Actions, GitLab CICD, Terraform, Docker, Helm, Python, Bash Scripting
  • MLOps & Model Serving: MLFlow, Kubeflow, VertexAI Pipelines, AWS SageMaker, NVIDIA Triton, VLLM
  • GenAI & LLMs: LLM deployment (VLLM), GenAI pipelines, TTS/ASR model integration (NVIDIA Riva), Digital Avatars
  • Observability: Prometheus, Grafana, CloudWatch

Certification

  • AWS Certified DevOps Engineer certification
  • Associate Cloud Engineer certification
  • Oracle Cloud Infrastructure Certified Architect Associate
  • Oracle Machine Learning using Autonomous Database Certified Associate

Timeline

Senior Platform Engineer

Quantiphi Analytics
08.2021 - Current

Cloud SysOps Associate

CyberNX Technologies
09.2020 - 08.2021

B.Tech - Computer Science

CMR Institute of Technology

Similar Profiles

CREATE PROFILE
Arun ReddySenior Platform Engineer