Dipali Kendre
Pune
Summary
Skilled Hadoop Administrator with expertise in managing large scale clusters. Demonstrated capability in troubleshooting technical issues, optimizing data processing, and ensuring system security. Strengths in cluster planning, installation, configuration, performance tuning, and system monitoring. Achieved significant improvements in system efficiency and data processing times.
Overview
6
6
years of professional experience
1
1
Certification
Work History
Sr. DevOps Engineer
phData
Bangalore
12.2018 - Current
- Working with the following Hadoop Ecosystem components including HDFS, Hive, Spark,Impala, YARN, Zookeeper, MapReduce, Kudu, Sentry, Hue, Kafka, SQOOP
- Good Experience in Source Code Repository Git, And Configuration management, Deployment tool Ansible.
- Identified opportunities for process improvements to decrease in support calls.
- Maintained and monitored production environments for high availability, scalability, and performance.
- Configured cloud services utilizing Amazon Web Services.
- Created detailed documentation of processes, procedures, and standards utilized in the environment.
- Performed troubleshooting on a variety of issues impacting system health or performance.
- Analyzed existing infrastructure and systems for optimization opportunities.
- Maintained user accounts on all nodes within a distributed computing environment based on Linux and Unix operating systems.
- Worked closely with development teams during application deployment process by providing necessary guidance regarding best practices for utilizing Big Data technologies.
- Created automated scripts for simplifying administrative tasks such as backup operations and monitoring jobs.
- Provided technical support in troubleshooting hardware and software problems associated with nodes in the cluster.
- Configured and administered HDFS, MapReduce, Pig, Hive, Oozie, Sqoop, Flume and ZooKeeper components of the Hadoop ecosystem.
- Resolved complex issues related to data storage, access control and job scheduling in Hadoop environment.
- Monitored and optimized performance of Hadoop clusters using Cloudera Manager tool.
- Managed multiple production clusters running different version of Apache Hadoop framework.
- Analyzed log files from different services running within the Hadoop infrastructure to identify potential issues.
- Assisted in setting up environment variables, configuring core-site xml, hdfs site xml .
- Monitored job progress through command line interface tools like yarn, spark2-submit, spark-shell .
- Tuned Spark configurations to achieve optimal execution times of batch processes.
- Worked closely with systems analysts, engineers and programmers to understand limitations, develop capabilities and resolve software problems.
Education
Bachelor of Engineering - Computer Science
Jaywantrao Sawant College of Engineering
Pune, Maharashtra07-2017
Skills
- Bigdata: HDFS, Spark/pyspark, Hive, Impala, Sqoop, Zookeeper, Mapreduce, Yarn, Kudu, Hue, Sentry, kafka, snowflake
- DevOps Tools: Git, Ansible, Docker, Rundeck, kubernetes, Jenkins, CI/CD
- Scripting: Linux Shell
- Programming: Python
- Databases: Mysql, SQL
- Cloud: AWS
- OS: Linux
- Incident Management
- Scripting Languages
- Database Administration
- Performance Tuning
- Disaster Recovery
- Python Programming
- Technical Troubleshooting
- Diagnosing issues
- Data Backup
- Multitasking
Certification
SnowPro Core Certification
Tools and skills
- Bigdata: HDFS, Spark, Hive, Impala, Sqoop, Zookeeper, Mapreduce, Yarn, Streamsets, Kudu, Hue, Sentry
- DevOps Tools: Jira, Git, Ansible, Docker, Rundeck
- Scripting: Linux Shell, AWK, SED
- Programming: Python
- Databases: Mysql, SQL
- Monitoring tools: Cloud watch, Catlight
- OS: Centos, Ubuntu, Windows, Mac-OS, Redhat
Languages
Marathi
First Language
Timeline
Sr. DevOps Engineer
phData
12.2018 - Current
Bachelor of Engineering - Computer Science
Jaywantrao Sawant College of Engineering
Similar Profiles
PRAKHAR JAINPRAKHAR JAIN
Associate Service Delivery Manager at phDataAssociate Service Delivery Manager at phData
Kashish NayyarKashish Nayyar
Lead Data Engineer at phDataLead Data Engineer at phData
Agneesh PriyadarshiAgneesh Priyadarshi
Sr Snowflake DBA at phData Solution Pvt LtdSr Snowflake DBA at phData Solution Pvt Ltd