Sushant Waghmode

• Deploying, Maintaining and Administrating a Hadoop Clusters
• Responsible for implementation and support of the Enterprise Hadoop Environment
• Experienced in Hadoop cluster configuration and deployment to integrate with system hardware in the AWS
• Experienced in setting Cloudera Hadoop prerequisite on Linux server
• Installation and managing Cloudera Hadoop on POC
• Upgraded Cloudera Manager and CDH for POC
• Worked on various component of AWS Cloud like S3, and EC2
• Monitor Hadoop cluster Health, Connectivity and Performance
• Analyze Hadoop log files
• File system management and monitoring
• Setting up new Hadoop users
• Working Knowledge of Cloudera Manager
• Responsible for new and existing administration of Hadoop infrastructure
• Upgraded Cloudera Manager and CDH for production clusters
• Configuring User & Group Management in Hue
• HA (High Availability) configuration of NameNode in production with onshore team
• Providing support to client on daily basis to resolve their queries in effective manner
• Working closely with Hadoop developers, System Admin, Hive Developers, Spark Developers, and Impala Developers for Hadoop Support
• Involved in start to end process of hadoop cluster setup where in installation, configuration and monitoring the Hadoop Cluster
• Adding/removing new nodes to an existing Hadoop cluster
• Configured various property files based upon the job requirement
• Understand Hadoop main components and Architecture
• Implementation and Support the Enterprise Hadoop environment
• Been a part of POC team and help build new Hadoop clusters and Hadoop Deployment
• Troubleshooting, diagnosing, tuning and solving Hadoop issues
• Worked with the range of big data components such as HDFS, Yarn, MapReduce, Tez, Hive, Impala, Spark, Scoop, Oozie, and Hue
• Commissioning and decommissioning of nodes as per the requirements
• Fine tune applications and systems for high performance and higher volume throughput
• Configuring YARN performance tuning for better data processing
• Configuring hive performance tuning for efficient data processing
• Maintaining the quorum for the zookeeper in the cluster as per the cloudera standards

Core Competencies Professional Experience

Detail-oriented Cloudera Hadoop Administrator with over 3 years of hands-on experience in deploying, configuring, and managing Hadoop clusters using Cloudera Distribution (CDH) And CDP. Proficient in monitoring and maintaining Hadoop components, ensuring high availability and performance, troubleshooting issues, and optimizing cluster performance. Strong background in Linux/Unix administration, security management, and scripting for automation. Adept at collaborating with cross-functional teams and ensuring smooth operations in big data environments.

• Hadoop Ecosystem (HDFS, YARN, Hive, Impala, HBase, Spark)
• Cloudera Manager and Cluster Monitoring
• Linux/Unix System Administration (RedHat, CentOS)
• Performance Tuning and Optimization
• Security Management (Kerberos, Ranger, Sentry)
• Data Backup, Recovery, and Disaster Recovery
• Scripting and Automation (Bash, Python)
• Troubleshooting and Problem Resolution
• Cluster Installation and Configuration
• Job Scheduling and Resource Management
• Capacity Planning and System Scaling
• Documentation and Reporting

• Administered and maintained Cloudera Hadoop (CDH) clusters, ensuring high availability and performance of components such as HDFS, YARN, Hive, Impala, and Spark.
• Monitored cluster performance using Cloudera Manager and proactively identified issues related to resource utilization, storage, and job execution.
• Conducted performance tuning to optimize resource allocation, memory usage, and job scheduling, improving overall cluster efficiency by 20%.
• Implemented and managed security measures, including Kerberos authentication and Cloudera Ranger, ensuring compliance with internal security policies.
• Automated routine tasks such as backups, system health checks.
• Collaborated with development teams to ensure smooth integration of big data workflows and troubleshoot Hadoop-related issues in real-time.
• Managed cluster upgrades and patching processes, minimizing downtime and ensuring the system was up to date with the latest Cloudera features.
• Supported data backup, recovery strategies, and disaster recovery plans, ensuring quick recovery of data in case of failure.
• Assisted in the setup, configuration, and maintenance of Cloudera Hadoop clusters in a production environment.
• Worked with senior admins to monitor cluster performance, troubleshoot system issues, and manage resource allocation within YARN.
• Performed routine backups, conducted recovery tests, and ensured data consistency within HDFS.
• Developed Python scripts to automate data workflows, cluster health checks, and resource provisioning tasks.
• Assisted in managing Hadoop security using Kerberos and Ranger for user authentication and authorization control.
• Collaborated with cross-functional teams to provide technical support for data-related issues and optimize Hadoop cluster performance.