PAVAN T

Hadoop Administrator

wipro

Bengaluru

05.2022 - Current

Strong knowledge of Cloudera distribution and its ecosystem, hands-on experience on CDH (6.3 & 6.4), CDP (7.1.8) versions.
Hands-on experience in managing the Hadoop service, such as HDFS, Hive, Hue, and Impala failure scenarios.
HDFS support and maintenance, planning of Backup, High Availability, and Disaster Recovery Infrastructure.
Experience in screening Hadoop cluster job performances, database backup and recovery, managing and reviewing Hadoop log files.
Better understanding of installation, configuration, supporting, and managing Hadoop Clusters (CDP).
Creation of yarn and Impala pools in the cluster and assigning resources as per user's request and use case.
Monitoring the cluster alerts and notifications using tools such as Cloudera Manager, Dynatrace, Acceldata Pulse, and so on.
Managing and reviewing Hadoop log files.
Maintaining SLA of Incidents and Change Requests as part of support.
Anticipating problems and taking decisive action to solve the issues without impact on both development clusters and production cluster.
Creating databases in Hive and roles at the Sentry level, and assigning them as per the requirement.
Creating snapshots and scheduling snapshot policies to prevent accidental deletion of data.
Addition of nodes and configuring Hadoop services.
Moving data between clusters by using Distributed Copy and Replication.
Rebalancing of the HDFS, disk space management, and directing quota administration in case of space problems.
Processing the events of Hadoop logs, taking measures, correcting errors, and involving the relevant teams if necessary.
Creating weekly and monthly status reports, coordinating with the client during the meetings about the key points mentioned in the reports, and taking required actions as per the suggestions.
Managing user account creation, deletion, modification, ACLs, and Ranger permissions.
Occasionally performing commissioning and decommissioning of nodes.
Backups, Snapshots, and recovery from node failure.
Configuring various XML files of the Hadoop ecosystem like Core-site.xml, Hdfs-site.xml, Mapred-site.xml, and Yarn-site.xml.
To recognize and kill the jobs that are stuck and not making progress in order to maintain the cluster's performance. Setting up Alerts for services in the Hadoop ecosystem.
Resolved complex issues related to data storage, access control and job scheduling in Hadoop environment.
Provided technical support in troubleshooting hardware and software problems associated with nodes in the cluster.
Managed multiple production clusters running on the Apache Hadoop framework.
Worked closely with development teams during application deployment process by providing necessary guidance regarding best practices for utilizing Big Data technologies.

Summary

Overview

Work History

Hadoop Administrator

Education

Bachelor of Engineering - Mechanical Engineering

Skills

Accomplishments

Certification

Languages

Timeline

Hadoop Administrator

Bachelor of Engineering - Mechanical Engineering

Similar Profiles

Ankan BeraAnkan Bera

Dhanasekaran GDhanasekaran G

Jenna LegerJenna Leger

Yogesh YadavYogesh Yadav

Sabir PashaSabir Pasha