PAVAN T
Bengaluru
Summary
Resourceful Hadoop Administrator known for high productivity and efficient task completion. Skilled in cluster management, data processing, and security implementation. Excel in problem-solving, communication, and teamwork, ensuring projects are completed within deadlines while adhering to quality standards.Proven background in troubleshooting Hadoop issues
Overview
2
2
years of professional experience
1
1
Certification
Work History
Hadoop Administrator
wipro
Bengaluru
05.2022 - Current
- Strong knowledge of Cloudera distribution and its ecosystem, hands-on experience on CDH (6.3 & 6.4), CDP (7.1.8) versions.
- Hands-on experience in managing the Hadoop service, such as HDFS, Hive, Hue, and Impala failure scenarios.
- HDFS support and maintenance, planning of Backup, High Availability, and Disaster Recovery Infrastructure.
- Experience in screening Hadoop cluster job performances, database backup and recovery, managing and reviewing Hadoop log files.
- Better understanding of installation, configuration, supporting, and managing Hadoop Clusters (CDP).
- Creation of yarn and Impala pools in the cluster and assigning resources as per user's request and use case.
- Monitoring the cluster alerts and notifications using tools such as Cloudera Manager, Dynatrace, Acceldata Pulse, and so on.
- Managing and reviewing Hadoop log files.
- Maintaining SLA of Incidents and Change Requests as part of support.
- Anticipating problems and taking decisive action to solve the issues without impact on both development clusters and production cluster.
- Creating databases in Hive and roles at the Sentry level, and assigning them as per the requirement.
- Creating snapshots and scheduling snapshot policies to prevent accidental deletion of data.
- Addition of nodes and configuring Hadoop services.
- Moving data between clusters by using Distributed Copy and Replication.
- Rebalancing of the HDFS, disk space management, and directing quota administration in case of space problems.
- Processing the events of Hadoop logs, taking measures, correcting errors, and involving the relevant teams if necessary.
- Creating weekly and monthly status reports, coordinating with the client during the meetings about the key points mentioned in the reports, and taking required actions as per the suggestions.
- Managing user account creation, deletion, modification, ACLs, and Ranger permissions.
- Occasionally performing commissioning and decommissioning of nodes.
- Backups, Snapshots, and recovery from node failure.
- Configuring various XML files of the Hadoop ecosystem like Core-site.xml, Hdfs-site.xml, Mapred-site.xml, and Yarn-site.xml.
- To recognize and kill the jobs that are stuck and not making progress in order to maintain the cluster's performance. Setting up Alerts for services in the Hadoop ecosystem.
- Resolved complex issues related to data storage, access control and job scheduling in Hadoop environment.
- Provided technical support in troubleshooting hardware and software problems associated with nodes in the cluster.
- Managed multiple production clusters running on the Apache Hadoop framework.
- Worked closely with development teams during application deployment process by providing necessary guidance regarding best practices for utilizing Big Data technologies.
Education
Bachelor of Engineering - Mechanical Engineering
S.V. College of Engineering
Tirupati07-2022
Skills
- CLOUDERA MANAGER
- HDFS
- HIVE
- IMPALA
- YARN
- RANGER
- SENTRY
- HUE
- SPARK
- DYNATRACE
- ACCELDATA PULSE
- Performance Tuning
Accomplishments
- Got Many Appreciations from the client Management
Certification
- Google Cloud Associate Cloud Engineer
Languages
Telugu
First Language
English
Proficient (C2)
C2
Tamil
Advanced (C1)
C1
Hindi
Intermediate (B1)
B1
Timeline
Hadoop Administrator
wipro
05.2022 - Current
Bachelor of Engineering - Mechanical Engineering
S.V. College of Engineering