Wasim Khan
Senior Big Data DevOps Engineer
Pune,Maharashtra
Summary
Experienced Big Data DevOps Engineer with over 4+ years of experience in Clairvoyant LLC , NTT | Netmagic & Freelancing. Excellent reputation for resolving problems and improving customer satisfaction through dedication, hard work & perseverance.
Overview
4
4
years of post-secondary education
6
6
years of professional experience
Work History
Trainer & Consultant
Freelancing
Pune, Maharashtra
07.2020 - Current
- Providing online assistance to clients on call and/or via. remote desktop.
- Providing online training on Linux Administration, Big Data Ecosystem & DevOps Technology.
- Working on small technical projects via. bidding through my various Freelancing accounts.
- Deploying automated IT infrastructure and defining seamless system integration and deployment conforming to best development practices.
- Conducting automated tests to identify system vulnerabilities and react more quickly to potential future threats.
- Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
- Monitoring performance and advising any necessary infrastructure changes
- Defining data retention policies
Senior Big Data DevOps
NTT Netmagic
Mumbai, Maharashtra
08.2018 - 06.2020
- Expert in Linux (Resource Management / Processes Managements) / Troubleshooting.
- Deployment of web servers and services via Ansible.
- Provisioned load balancer, EC2 instance, auto-scaling group and launch configuration for micro services using Ansible.
- Implemented Ansible to manage all existing servers.
- Using of terraform installation, configuration, migration, failover and up-gradation of Ansible tower cluster Provisioning servers and installing required software in multiple EC2 hosts with Ansible playbook.
- Highly skilled in Linux, Ansible, Agile Methodologies, DevOps, Terraform, Docker, Kubernetes, AWS cloud Experience with Hadoop ecosystem tools HDFS, MapReduce V1/V2, YARN, Pig, Hive, Zookeeper, Sqoop, Flume, Hue, Ambari, HBase.
- Experience in setting up and managing the entire Hadoop infrastructure right from scratch.
- Good hands on with Resource Management pools i.e Static Allocation, Dynamic Allocation.
- Strong Knowledge in performing the Hadoop Admin Day to Day Activities (Overriding Configurations, Performance Tuning, Commissioning and decommissioning nodes, monitoring).
- Expertise in Hadoop Issues investigation.
- Experience in setting up Hbase cluster and resolving daily challenges.
- Experience in managing/setting up Kafka cluster.
- Working with Enterprise Cloudera Hadoop Distribution (CDH).
- 2 Ensuring the support for Cluster / Service / Task and Host level Issues.
- Having in depth knowledge of Zookeeper.
- Having experience in Enterprise Deploying of Hadoop Cluster on-prem and cloud.
- Assist the Data Engineering / Dev team in identifying the root cause of slow performing jobs / queries.
- Troubleshooting, diagnosing, tuning cluster & Interpreting a log file.
- Have successfully upgraded ELK Stack i.e Elastic Search, Logstash and Kibana from version 5.0 to newer stable version.
- Involved in data flow for Infrastructure with HDF / NiFi Expert in Performance Tuning of OS / Hadoop Core and Hadoop Ecosystem Tools (MapReduce, Spark, hive, Impala, HBase) / Expertise in OS tuning for Hadoop.
- Experienced with upgrading the Cloudera cluster with Major or Minor Upgrade through Parcels.
- Experience in High Availability, Backup And Recovery and Disaster Recovery strategies (Snapshots and Replication).
- Implemented Hadoop Security (Kerberos, Sentry, ACL, TLS).
- Hands on experience in setting up and managing Redis, mongo DB database.
- Expertise in setting Docker container.
Big Data DevOps Engineer
Clairvoyant LLC
Pune, Maharashtra
08.2016 - 02.2018
- Expertise in Deploying Cloudera / Hortonworks Cluster.
- Hands on expertise in Ansible for Automation.
- Good hands on with Resource Management pools i.e Static Allocation, Dynamic Allocation.
- Expert in Benchmarking the cluster with Teragen, TeraSort, TestDFSIO.
- Experience in setting up HBase cluster and resolving daily challenges.
- Expertise in setting up High Availability (H.A) for HDFS and YARN services.
- Good with upgrading the Cloudera cluster with Major or Minor Upgrade through Parcels.
- Ability to configure TLS-SSL encryption with all three levels for securing the Hadoop cluster.
- Good at Kerberizing (Kerberos) the Cluster.
- Have successfully set up separate KAFKA cluster under Cloudera Manager.
- And also good Hands-On Experience with Apache Kafka.
- Good hands on Authorization with Sentry for restricting/providing different users with different privileges within specific group.
- Monitoring and troubleshooting client's Production and Development Clusters.
- Expertise in setting up cluster through Terraform Script.
- Commissioning and Decommissioning of Nodes.
- Installation of Airflow through Manual and bash scripts.
- Hands on expertise on kudu installation, configuration and administration.
- Configuration of HDFS encryption zones.
- Good hands on YARN Tuning.
- Expertise in CM and CDH upgrade.
- Expertise in Ambari and HDP upgrade.
- Good with Hortonworks HDP distribution for troubleshooting and debugging the issues.
Hardware & Networking Technician
Apt Choice Services
Pune, Maharashtra
12.2009 - 04.2012
- Experienced working and dealing with dynamic customers providing them end-to-end support related to Hardware/Network/OS/Software with strong communication and organizational skills.
- Support Customer's queries Over Phone / On Premise.
- Direct clients/customers through a series of actions to help set up systems or resolve issues.
- Provide support, including procedural documentation and relevant reports Create, follow diagrams and written instructions to repair a fault or set up a system.
- Research, diagnose, troubleshoot and identify solutions to resolve customer issues.
- 3 Escalate advanced and time sensitive issues on an as needed basis Document maintenance for all computer systems and network infrastructure.
- Service R&D and technical documentation and standards operating procedures.
- Install and configure computer hardware operating systems and applications.
- Monitor and maintain computer systems and networks.
- Network Implementation and Troubleshooting.
Education
B.Sc. - Computer Science
Savitribai Phule Pune University
07.2012 - 03.2015
HSC -
Maharashtra Board
07.2008 - 03.2009
SSC -
Maharashtra Board
06.2006 - 03.2007
Skills
Cloudera(CDH)
Hortonworks(HDP)
Kafka
Hadoop Ecosytem
MIT Kerberos & Active Directory
AWS EC2 , S3
Ansible
Vagrant
Terraform
Docker
Kubernetes
ELK Stack ie Elasticsearch, Logstash , Kibana
HBase Administration
Hive, Spark, Impala
Cloud Computing
ACL's
Linux OS - Centos , Ubuntu, Red hat
Timeline
Trainer & Consultant
Freelancing
07.2020 - Current
Senior Big Data DevOps
NTT Netmagic
08.2018 - 06.2020
Big Data DevOps Engineer
Clairvoyant LLC
08.2016 - 02.2018
B.Sc. - Computer Science
Savitribai Phule Pune University
07.2012 - 03.2015
Hardware & Networking Technician
Apt Choice Services
12.2009 - 04.2012
HSC -
Maharashtra Board
07.2008 - 03.2009
SSC -
Maharashtra Board
06.2006 - 03.2007