Summary
Overview
Work History
Education
Skills
Timeline
Generic

Wasim Khan

Senior Big Data DevOps Engineer
Pune,Maharashtra

Summary

Experienced Big Data DevOps Engineer with over 4+ years of experience in Clairvoyant LLC , NTT | Netmagic & Freelancing. Excellent reputation for resolving problems and improving customer satisfaction through dedication, hard work & perseverance.

Overview

4
4
years of post-secondary education
6
6
years of professional experience

Work History

Trainer & Consultant

Freelancing
Pune, Maharashtra
07.2020 - Current
  • Providing online assistance to clients on call and/or via. remote desktop.
  • Providing online training on Linux Administration, Big Data Ecosystem & DevOps Technology.
  • Working on small technical projects via. bidding through my various Freelancing accounts.
  • Deploying automated IT infrastructure and defining seamless system integration and deployment conforming to best development practices.
  • Conducting automated tests to identify system vulnerabilities and react more quickly to potential future threats.
  • Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
  • Monitoring performance and advising any necessary infrastructure changes
  • Defining data retention policies

Senior Big Data DevOps

NTT Netmagic
Mumbai, Maharashtra
08.2018 - 06.2020
  • Expert in Linux (Resource Management / Processes Managements) / Troubleshooting.
  • Deployment of web servers and services via Ansible.
  • Provisioned load balancer, EC2 instance, auto-scaling group and launch configuration for micro services using Ansible.
  • Implemented Ansible to manage all existing servers.
  • Using of terraform installation, configuration, migration, failover and up-gradation of Ansible tower cluster Provisioning servers and installing required software in multiple EC2 hosts with Ansible playbook.
  • Highly skilled in Linux, Ansible, Agile Methodologies, DevOps, Terraform, Docker, Kubernetes, AWS cloud Experience with Hadoop ecosystem tools HDFS, MapReduce V1/V2, YARN, Pig, Hive, Zookeeper, Sqoop, Flume, Hue, Ambari, HBase.
  • Experience in setting up and managing the entire Hadoop infrastructure right from scratch.
  • Good hands on with Resource Management pools i.e Static Allocation, Dynamic Allocation.
  • Strong Knowledge in performing the Hadoop Admin Day to Day Activities (Overriding Configurations, Performance Tuning, Commissioning and decommissioning nodes, monitoring).
  • Expertise in Hadoop Issues investigation.
  • Experience in setting up Hbase cluster and resolving daily challenges.
  • Experience in managing/setting up Kafka cluster.
  • Working with Enterprise Cloudera Hadoop Distribution (CDH).
  • 2 Ensuring the support for Cluster / Service / Task and Host level Issues.
  • Having in depth knowledge of Zookeeper.
  • Having experience in Enterprise Deploying of Hadoop Cluster on-prem and cloud.
  • Assist the Data Engineering / Dev team in identifying the root cause of slow performing jobs / queries.
  • Troubleshooting, diagnosing, tuning cluster & Interpreting a log file.
  • Have successfully upgraded ELK Stack i.e Elastic Search, Logstash and Kibana from version 5.0 to newer stable version.
  • Involved in data flow for Infrastructure with HDF / NiFi Expert in Performance Tuning of OS / Hadoop Core and Hadoop Ecosystem Tools (MapReduce, Spark, hive, Impala, HBase) / Expertise in OS tuning for Hadoop.
  • Experienced with upgrading the Cloudera cluster with Major or Minor Upgrade through Parcels.
  • Experience in High Availability, Backup And Recovery and Disaster Recovery strategies (Snapshots and Replication).
  • Implemented Hadoop Security (Kerberos, Sentry, ACL, TLS).
  • Hands on experience in setting up and managing Redis, mongo DB database.
  • Expertise in setting Docker container.

Big Data DevOps Engineer

Clairvoyant LLC
Pune, Maharashtra
08.2016 - 02.2018
  • Expertise in Deploying Cloudera / Hortonworks Cluster.
  • Hands on expertise in Ansible for Automation.
  • Good hands on with Resource Management pools i.e Static Allocation, Dynamic Allocation.
  • Expert in Benchmarking the cluster with Teragen, TeraSort, TestDFSIO.
  • Experience in setting up HBase cluster and resolving daily challenges.
  • Expertise in setting up High Availability (H.A) for HDFS and YARN services.
  • Good with upgrading the Cloudera cluster with Major or Minor Upgrade through Parcels.
  • Ability to configure TLS-SSL encryption with all three levels for securing the Hadoop cluster.
  • Good at Kerberizing (Kerberos) the Cluster.
  • Have successfully set up separate KAFKA cluster under Cloudera Manager.
  • And also good Hands-On Experience with Apache Kafka.
  • Good hands on Authorization with Sentry for restricting/providing different users with different privileges within specific group.
  • Monitoring and troubleshooting client's Production and Development Clusters.
  • Expertise in setting up cluster through Terraform Script.
  • Commissioning and Decommissioning of Nodes.
  • Installation of Airflow through Manual and bash scripts.
  • Hands on expertise on kudu installation, configuration and administration.
  • Configuration of HDFS encryption zones.
  • Good hands on YARN Tuning.
  • Expertise in CM and CDH upgrade.
  • Expertise in Ambari and HDP upgrade.
  • Good with Hortonworks HDP distribution for troubleshooting and debugging the issues.

Hardware & Networking Technician

Apt Choice Services
Pune, Maharashtra
12.2009 - 04.2012
  • Experienced working and dealing with dynamic customers providing them end-to-end support related to Hardware/Network/OS/Software with strong communication and organizational skills.
  • Support Customer's queries Over Phone / On Premise.
  • Direct clients/customers through a series of actions to help set up systems or resolve issues.
  • Provide support, including procedural documentation and relevant reports Create, follow diagrams and written instructions to repair a fault or set up a system.
  • Research, diagnose, troubleshoot and identify solutions to resolve customer issues.
  • 3 Escalate advanced and time sensitive issues on an as needed basis Document maintenance for all computer systems and network infrastructure.
  • Service R&D and technical documentation and standards operating procedures.
  • Install and configure computer hardware operating systems and applications.
  • Monitor and maintain computer systems and networks.
  • Network Implementation and Troubleshooting.

Education

B.Sc. - Computer Science

Savitribai Phule Pune University
07.2012 - 03.2015

HSC -

Maharashtra Board
07.2008 - 03.2009

SSC -

Maharashtra Board
06.2006 - 03.2007

Skills

    Cloudera(CDH)

undefined

Timeline

Trainer & Consultant

Freelancing
07.2020 - Current

Senior Big Data DevOps

NTT Netmagic
08.2018 - 06.2020

Big Data DevOps Engineer

Clairvoyant LLC
08.2016 - 02.2018

B.Sc. - Computer Science

Savitribai Phule Pune University
07.2012 - 03.2015

Hardware & Networking Technician

Apt Choice Services
12.2009 - 04.2012

HSC -

Maharashtra Board
07.2008 - 03.2009

SSC -

Maharashtra Board
06.2006 - 03.2007

Similar Profiles

CREATE PROFILE
Wasim KhanSenior Big Data DevOps Engineer