SAGAR J
Hadoop Admin
Bangalore,Karnataka
Summary
- 3.3 years of experience in IT industry, currently working as a Hadoop Administrator at Trinity Moblity Pvt Ltd on BigData using Cloud Platforms.
- Skilled in cluster maintenance, troubleshooting, monitoring, backup & recovery strategies, and Hadoop ecosystem installation.
- Expertise in commissioning and decommissioning nodes, configuring backup, and recovering from Name Node failures.
- Proficient in setting up Kerberos security using Cloudera Manager, and installation and configuration of various Hadoop ecosystems.
- Experience in HDFS tuning, MapReduce, YARN architecture with high availability and analyzing log files for root cause identification.
- Implemented CDH and set up Hadoop & Kafka ecosystems using both manual configurations and automation scripts.
Overview
3
3
years of professional experience
Work History
Big Data Admin
Trinity Mobility Pvt Ltd
Bengaluru
02.2022 - 05.2024
- Managed cluster maintenance, troubleshooting, and performance tuning
- Configured and monitored HDFS, YARN, MapReduce, and other Hadoop services
- Implemented backup strategies and disaster recovery plans using GCP
- Provided 24/7 on-call support for production environments, ensuring prompt resolution of critical issues
- Installed and managed Cassandra clusters for high availability and fault tolerance.
Trainee
ConnectM Technology Solutions Pvt Ltd
06.2018 - 07.2019
- Assisted in deploying and maintaining Hadoop clusters
- Supported various data processing and analysis projects.
Education
Bachelor of Science - Computer Science
KS School of Engineering And Management
Bengaluru07-2016
Skills
- Big Data/Hadoop: HDFS, YARN, MapReduce, HBase, Hive, Tez, Kafka, Zookeeper, Apache Ranger, Atlas, Solr, Spark, Sentry, Impala, HUE, OOZIE
- Programming Languages: Java (Intermediate), Python (Beginner), Shell Scripting
- Databases: Postgres SQL, MongoDB, HBase, MySQL, Cassandra
- Distribution Management: CDH, Hortonworks, Apache Hadoop, Bigtop
- Operating Systems: Linux, Windows XP/10, Ubuntu, Red Hat 7-9, CentOS 6-9
- Applications: Druid, Oracle Application Support, SQL Server Management Studio, SQL Developer, Cloudera Manager, Kafka Tool
Personal Information
Date of Birth: 06/05/1994
Languages
- Kannada
- English
- Tamil
- Telugu
Projects
Projects Undertaken
Bengaluru Safe City
- Duration: March 2023 - Present
- Tools Used: HDP, Ambari,HDFS, HBase, Hive, Phoenix, Kafka, Zookeeper, YARN, MapReduce2
- Description: Installed and configured a comprehensive Hadoop ecosystem to establish a robust vehicle tracking system.
- Implemented HDFS for data storage and management.
- Set up HBase for real-time data querying and processing.
- Developed Hive queries for data analysis and reporting.
- Integrated Apache Kafka for real-time data streaming and processing.
- Configured Zookeeper for centralized service management.
- Orchestrated resource allocation and scheduling using YARN.
- Ensured seamless operation and performance optimization of the Hadoop ecosystem.
Maha112 - Complaint Register and Emergency Service
- Duration: March 2023 - Present
- Tools Used: Similar to Bengaluru Safe City project.
- Description: Implemented a Hadoop-based system to manage emergency service data efficiently.
EWDS - Early Warning Disaster Management System
- Duration: March 2022 -June 2022
- Tools Used: Similar to Bengaluru Safe City project.
- Description: Developed a disaster management system using the Hadoop ecosystem to ensure timely warnings and data management.
Chennai Smart City
- Duration: July 2022 - February 2023
- Tools Used: Similar to Bengaluru Safe City project.
- Description: Installed and configured the Hadoop ecosystem for smart city data management and analytics.
AP-108 Emergency Service
- Duration: March 2023 - November 2023
- Tools Used: Similar to Bengaluru Safe City project.
- Description: Implemented a robust data management system for emergency services.
Apache Bigtop and Ambari 2.8.0
- Duration: July 2023 - Present
- Tools Used: Bigtop, Ambari, HDFS, HBase, Hive, Phoenix, Kafka, Zookeeper, YARN, Ranger, Druid, Atlas, Spark2, MapReduce
- Description: Engaged in R&D focusing on Apache Bigtop and Ambari 2.8.0, ensuring the latest tools and technologies are integrated within the Hadoop ecosystem.
Timeline
Big Data Admin
Trinity Mobility Pvt Ltd
02.2022 - 05.2024
Trainee
ConnectM Technology Solutions Pvt Ltd
06.2018 - 07.2019
Bachelor of Science - Computer Science
KS School of Engineering And Management