Abhimanyu Kumar
DevOp and Bigdata hadoop Admin
Bengaluru
Summary
Results-oriented Hadoop Administrator & DevOps Engineer with 5+ years of experience managing, securing, and optimizing large-scale distributed data systems across on-prem and AWS environments. Proven expertise in installing, configuring, and maintaining Hadoop ecosystem components (HDFS, YARN, Hive, Spark, HBase, Oozie, ZooKeeper) and ensuring high availability, performance, and security through Kerberos, Ranger, and automated monitoring. Strong background in DevOps automation, CI/CD, containerization (Docker, Kubernetes), and cloud infrastructure (AWS, Terraform, Ansible). Known for proactive problem-solving, system reliability improvement, and collaboration with cross-functional data teams.
Overview
5
5
years of professional experience
Work History
DevOps & Hadoop Administrator
Translab Technology Pvt. Ltd.
09.2025 - Current
- Responsibilities:
- Deploying and managing Kubernetes clusters for big data workloads with RBAC, TLS, and high availability configurations.
- Automating CI/CD pipelines using Jenkins, Terraform, and Helm for zero-downtime releases.
- Managing Spark, Hive, and Hadoop deployments in containerized and cloud-native environments.
- Implementing infrastructure monitoring using Grafana and Prometheus for performance metrics and alerts.
- Ensuring secure data flow between applications and Hadoop clusters using SSL and Kerberos integration.
- Performing capacity planning, resource tuning, and periodic cluster audits for stability and scalability.
DevOps Engineer & Big Data Hadoop Administrator
Rakuten Symphony India Pvt. Ltd.
12.2020 - 08.2025
- Key Contributions:
- Installed, configured, and maintained Hadoop clusters (200+ nodes) using Cloudera Manager and Ambari for enterprise-grade performance.
- Managed and optimized HDFS, YARN, Hive, Spark, Oozie, HBase, and ZooKeeper components with 99.9% uptime.
- Configured High Availability (HA) for HDFS NameNode, ResourceManager, and HBase Master, reducing downtime by 90%.
- Implemented Kerberos authentication and Apache Ranger authorization, improving data security and compliance.
- Automated cluster provisioning, user management, and service restarts using Ansible and Bash scripts.
- Monitored cluster metrics and set proactive alerts using Prometheus & Grafana dashboards.
- Conducted root cause analysis (RCA) for recurring system issues; implemented permanent fixes reducing reoccurrence by 40%.
- Collaborated with data engineers to ensure pipeline stability and optimized resource allocation in YARN queues.
- Key Achievements:
- Reduced job execution time by 30% through Spark/YARN performance tuning.
- Automated daily health checks and alert notifications, reducing manual intervention by 70%.
Education
Bachelor of Technology (B.Tech) - Information Technology
Orissa Engineering College
Bhubaneshwar 04.2001 -
Skills
Hadoop Administration (HDFS, YARN, Hive, Spark, HBase, Oozie, ZooKeeper)
Cluster Management: Cloudera Manager, Ambari, Hortonworks
Security: Kerberos, Ranger,Configuration
High Availability (HA) & Disaster Recovery (DR)
CI/CD Automation: Jenkins, Ansible, Terraform
Cloud: AWS (EC2, S3, IAM, EBS, CloudWatch, CloudTrail, VPC)
Containerization: Docker, Kubernetes, Helm
Scripting & Automation: Bash, Python
Monitoring: Prometheus, Grafana, Signoz, SkyWalking
Databases: MySQL, PostgreSQL
Timeline
DevOps & Hadoop Administrator
Translab Technology Pvt. Ltd.
09.2025 - Current
DevOps Engineer & Big Data Hadoop Administrator
Rakuten Symphony India Pvt. Ltd.
12.2020 - 08.2025
Bachelor of Technology (B.Tech) - Information Technology
Orissa Engineering College
04.2001 -