Summary
Overview
Work History
Education
Skills
Timeline
SoftwareEngineer
Pankaj Dubey

Pankaj Dubey

Data Engineer
Pune,MH

Summary

Analytical Senior Project Engineer with 9 years of expertise in completing projects to meet client expectations. Expert in coordinating project estimates, risk assessments and technical designs for projects. Attentive in consistently analyzing real-time project data and reviewing reports for informed decision-making and ongoing support. Studious leader when assisting and training engineers with less experience.

Overview

9
9
years of professional experience

Work History

Senior Project Engineer

Wipro
11.2018 - Current
  • Creation and Management Of Data Lake Technologies: Hadoop, Spark, Python, Scala, Elasticsearch, Kafka, Couchbase, Logstash
  • Project Summary:
  • This Project Is for PayPal dealing with the variety of databases and migrating them to Hadoop ecosystem
  • Technologies which were considered for this encompasses Hadoop ecosystem and a stack of NoSQL Databases with streaming using spark and processing engines for data movement (Logstash, Kafka, Elasticsearch, Couchbase)
  • Also worked on poc's for spark, elastic search and Kafka streaming for initial phase of the project

Software Engineer

11.2017 - 10.2018
  • Platform for Managing IOT Devices Technologies: Hadoop, Spark, Machine Learning, Python
  • Project Summary:
  • This is the combined application for managing and analyzing data coming from IOT devices installed on towers we need to have a combined and one platform for the collection processing and analysis also it automates whole data collection process
  • We also implemented the idea by providing vocal and graphical based complete analysis to the customer also we combined above mentioned ratings and the feature enhancement by constructing real time calculations based on Field/Knock Engineers feedback

Software Engineer

09.2017 - 11.2017
  • Compassionate Connected Care Technologies: IBM Watson, Tessract OCR, Natural Language Processing, Dictionary, HTML5, Jscript, Java
  • Project Summary : This is the combined application for the benefit of Healthcare Clients, also for the analysis of customer feedback we combined text, Audio as well as Image based feedbacks for the analysis

Software Specialist

01.2017 - 09.2017
  • I worked for the Detection of speech and Image detection using various open source and new and upcoming technologies like IBM Watson and Tessract OCR
  • I also used these technologies to make a sentiment analyzer for call centers using IBM Watson
  • Healthcare Analytics Workbench Technologies: R, R-Programming, HTML5, Jscript, Java, Python Project Summary:
  • Parallel Performance achieved for Naïve Bayes, Decision Tree, Support Vector Machine, Logistic Regression, Neural Network is under process

Software Engineer

Syntel Inc
01.2015 - 09.2017
  • Projects Done: Creation and Management Of Data Lake Technologies: Hadoop, Spark, Python, Scala, java, mainframe
  • Project Summary:
  • This Project Is for TD Bank dealing with the variety of databases and migrating them to reporting systems
  • Technologies which were considered for this encompasses Hadoop ecosystem and a stack of NoSQL Databases with streaming using spark and processing engines for data movement (Spark, python, java, hbase, mysql, ETL Pipelines)
  • Also working on project for creating data parser for cobol data sets using python

Software Developer

Activities Performed
11.2016 - 01.2017
  • Activities Performed (Software Developer):
  • Learned R programming and deployed whole R script onto java code with full integration
  • Integration of 2 main projects Healthcare and Analytics Workbench with all modules was done by me
  • HAAS (Hadoop as a Service)-Data Ingestion Technologies: Hadoop, Spark, Hive, Pig, HTML5, JavaScript, Java, Scoop, Tableau
  • Project Summary:
  • This is a State of the Art Self Developed Syntel project which gives any laymen business user a power to transfer, map, and store their data from contemporary databases to Hadoop, developed in 7 months HAAS has gained a lot of recognition among various clients as now business analyst can transfer and do various operations on the data by self only
  • I am working for the future enhancement by making various levels of authentication and integrating new databases
  • I have worked on integrating MYSQL, ORACLE and flat file into Data Ingestion
  • In future scope we will be trying to teach HAAS data filtering and cleansing by itself using some AI features, which are right now user controlled

Education

Bachelor of Engineering - Computer Science

NIIST
Bhopal
Aug 2010 - Jul 2014

Skills

Artificial intelligence

undefined

Timeline

Senior Project Engineer

Wipro
11.2018 - Current

Software Engineer

11.2017 - 10.2018

Software Engineer

09.2017 - 11.2017

Software Specialist

01.2017 - 09.2017

Software Developer

Activities Performed
11.2016 - 01.2017

Software Engineer

Syntel Inc
01.2015 - 09.2017

Bachelor of Engineering - Computer Science

NIIST
Aug 2010 - Jul 2014

Similar Profiles

CREATE PROFILE
Pankaj DubeyData Engineer