Hadoop Admin
ETEAMS INFO SERVICE PVT LTD
Hyderabad
- Part of L1 support
- Troubleshooting and resolving tickets related to servers in production
- Responsible for analysis of current programs for diagnosis and troubleshooting issues
- Wrote the new code for enhancements using Shell Scripting
- Completing the scheduled tasks within the stipulated time
- Participating in incident review meetings
- Documenting the production guides with the latest information
- Responding promptly and professionally to bug reports
- Wrote scripts for automation
- Interacting with client and providing effective communication on bridge
- Handling the issues related to installation, configuration, operations and performance Monitoring the servers through ambari, scheduling the jobs through oozie, monitoring the yarn jobs, hive jobs
- Involved in start to end process of Hadoop cluster setup which includes installation, configuration and monitoring the Hadoop Cluster
- Responsible for Cluster maintenance, commissioning and decommissioning Data nodes, Cluster Monitoring, Troubleshooting, Manage and review data backups, Manage & review Hadoop log files
- Monitoring systems and services, architecture design and implementation of Hadoop deployment, configuration management, backup, and disaster recovery systems and procedures
- Configured various configuration files like core-site.xml, hdfs-site.xml, mapred-site.xml based upon the requirement
- Importing and exporting data into HDFS using Sqoop, Hive
- Experienced in define being job flows with Oozie and cronjobs Loading log data directly into HDFS using Kafka Experienced in managing and reviewing Hadoop log files
- Installation of various Hadoop Ecosystems and Hadoop Daemons
- Installation and configuration of Hbase Managed and reviewed Hadoop Log files as a part of administration for troubleshooting purposes
- Communicate and escalate issues appropriately
- As an admin followed standard Back up policies to make sure the high availability of cluster
- Involved in Analyzing system failures, identifying root causes, and recommended course of actions
- Documented the systems processes and procedures for future references
- Installed and configured Hive, Kafka, Sqoop and Oozie on the Hadoop cluster
- Involved in Installing and configuring Kerberos for the authentication of users and hadoop daemons.