Vikash Pandey - Principal Software Engineer - Protegrity

Summary

Skilled Principal Software Engineer adept at executing development strategies via unique management and design style. Known for tackling unforeseen hiccups in software creation with agility and tireless commitment. Creative innovator of novel approaches to time-worn problems, proficient at employing colleagues and resources to combat everything from minor bugs to catastrophic software failures.

Overview

2

Languages

1

Certification

4

years of post-secondary education

9

years of professional experience

Work History

Principal Software Engineer

Protegrity

Bengaluru, Karnataka

04.2015 - Current

Currently working on ETL pipeline which take logs from various sources and ingest into Open Distro for Elasticsearch.
Working on Fluentd, used for preprocessing logs.
Generating Alerts for suspicious events derived from data ingested, using Open Distro for Elasticsearch API's.
Exhibited strong technical aptitude and application expertise resulting in optimized performance by 20%, continuous improvement recommendations and product innovation.
Perform code reviews, mentor junior developers and test engineers, and contribute to architectural changes.
Work with stakeholders to identify current and future business requirements and develop quality solutions. Advise management of potential improvements that could increase profit and customer satisfaction.
Integration of Open Distro for Elasticsearch into product.
Designed automation test framework.
Hands on experience on docker containers on cloud.
Worked on Big data ecosystem components like MapReduce, Hive, Impala, HBase, Spark, Pig, Hawq.
Experience on different Hadoop distributions like Cloudera, Hortonworks, MapR, Amazon EMR, GCP, Pivotal.
Involved in certifying Protegrity Bigdata security product for different Hadoop ecosystem components on Hadoop distributions like Cloudera, Hortonworks, MapR, Amazon EMR, GCP, Pivotal.
Hands on experience on server less data warehouse - Snowflake and self-managed Big data platform - Quoble data services.
Securing data using Protegrity security product on cloud. (Amazon EMR, GCP)
Analyzing and securing data in Spark using Spark Scala/SQL.
Analyzing and securing data in Hive through Hive shell. (Clients - Beeline, Hue).
Involved in creating, partitioning, bucketing of tables and experience in Hive query performance tuning.
Hands on experience in analyzing data in hive using TABLEAU.
Hands on experience in configuring and using, Node labeling & Ranger KMS feature of Hortonworks.
Hands on experience in using/integrating Talend with HDFS and securing data in HDFS using Talend.
Involved in writing Map-reduce programs to analyze data.
Writing shell/python scripts to automate performance tests on Hive, Impala, HBase.
Installing, configuring multi-node clusters in different distributions like Cloudera, Hortonworks, MapR, EMR, Pivotal.
Involved in POC in-house for analyzing logs using Elasticsearch-Log stash-Kibana (ELK) stack.
Involved in integration of MIT Kerberos and Active Directory to enable authentication.
Implementing Sentry, Ranger for fine-grained access control to data and metadata.
Extracting data from MySQL database using Sqoop, applying security techniques after loading it into HDFS through HBase and Hive tables.
Benchmarking Hawq against Hive
Worked in Agile development environment
Communicating with customers to understand their issues and provide them best possible solution.

Test/Quality/Performance Engineer

Tata Consultancy Services Limited

Mumbai, Maharashtra

01.2012 - 03.2015

Having experience on Managing HDFS file system.
Having hands on experience in writing Map Reduce jobs in Hive, Pig.
Installed and configured MapReduce, HIVE and HDFS;
Implemented CDH4 Hadoop cluster on CentOS in a pseudo-distributed mode.
Involved in writing Hive queries to load and process data in Hadoop File System.
Process and analyze data from Hive tables using HiveQL.
Involved with clients, IT -Team and business users to understand requirements.
Handling unit, system, integration, regression & user acceptance testing.
Provide user training and conducting UAT sessions to gain user confidence.
Communicating with customers to understand their issues while UAT and guide them to the closure.

Education

B.Tech - Information Technology

Sri Siddhartha Institute Of Technology

Tumkur

08.2007 - 04.2011

Skills

Programming Language : Python, Shell Scripting, SQL

Cloud Platforms : AWS, Azure, GCP

Hadoop Distribution: Amazon EMR, GCP, Cloudera, MapR, Pivotal, Hortonworks

Big Data Technologies: HDFS, MapReduce, Spark, Spark Stream Processing, Kafka, Hive, HBase, Sqoop, Impala, Hawq

Automation Framework : Python Behave(BDD)

Authentication/Authorization Technologies: Kerberos, Sentry, Ranger, KMS

Data Stores: MySQL, Postgres, Elasticsearch

Version Control System: SVN, Git

CI/CD: Jenkins

Visualization/ETL Tools: Tableau, Kibana, Talend, Fluentd

Project Management Tool: Jira

Agile

Linux operating system : RHEL, CentOS, OEL, SLES, Amazon Linux, Debian

Certification

Hortonworks Certified Associate Hortonworks License 362

Additional Information

cea58-ac12-47a4-abde-78dd6ca4d958 December 2016 ACHIEVEMENT Received “Employee of the month” award for certifying & identifying critical issues in the payment module within a very short time frame. Received “Employee of the month” award for providing excellent support to the customers, helping them to understand in and out of the application and for solving their queries. Received “On the spot award” award for demonstrating TCS-BaNCS product to a new customer with sales and BA team. Selected in college football and badminton team. Arranged funds to purchase books and other study materials to help poor kids.

Accomplishments

Received “Employee of the month” award for certifying & identifying critical issues in the payment module within a very short time frame.
Received “Employee of the month” award for providing excellent support to the customers, helping them to understand in and out of the application and for solving their queries.
Received “On the spot award” award for demonstrating TCS-BaNCS product to new customer with sales and Business Analysts team.
Selected in college football and badminton team.
Arranged funds to purchase books and other study materials to help poor kids.

Interests

Inclination towards learning and applying ML & AI

Have gone through multiple courses to learn basics of ML integration

Able to grasp new concepts quickly and efficiently

Timeline