Pallab Kundu

· Working as Spark, Livy and Yarn SME. Also, provide support for Kafka, Streams Replication Manager, Streams Messaging Manager & Nifi, Cloudera Data Engineering service(Spark on Kubernetes)

· Experience of upgrading CDH to CDP (Private and Public Cloud).

· Helping Customer to secure cluster with Kerberos and TLS.

· Working on JIRAs to build CDH and CDP clusters from scratch

· If approved internally, providing solution to customer if they want to integrate third party software with Cloudera Data Stack

· Writing customer facing Knowledge Base Articles.

· Providing Bootcamp training to new joiners and Advanced training to experienced COE on Spark & Yarn.

· Building separate team for a particular customer if they need faster resolution which requires expertise on multiple components.

· Working with Product Engineering Team to identify the bug and issues with Customer code.

· Leading a 10 members team to manage a 45 node MapR Hadoop cluster.

· Providing end-to-end support including Performance tuning,Data Security, Monitoring, Process building, Patching & Upgrading the cluster.

· Writing Spark jobs to load and unload data from the cluster.

· Integrating Streamsets with the MapR cluster.

· Was responsible for configuring log and metrics monitoring using ElasticSearch and OpenTSDB

· Configuring HAProxy for Mysql.

· Installing and configuring Multi-Nodes fully distributed Hadoop cluster

· Moving Data from Oracle to Hadoop using Sqoop and Spark

· Migrating data from DB2 to Oracle

· Upgrading and Patching Oracle Databases

· Migrating Oracle 11g DB from single node oracle database to ASM RAC.

· Implementing cloud plus monitoring implementation using UNIX shell script and Windows batch script