Summary
Overview
Work History
Education
Skills
Certification
Additional Information - Publications Awards
Software
Timeline
Generic

Rohit Dubey

Data & Business Intelligence Engineer
Bangalore

Summary

Detail-oriented, organized and meticulous employee. Works at fast pace to meet tight deadlines. Enthusiastic team player ready to contribute to company success.

Overview

11
11
years of professional experience
4
4
years of post-secondary education
1
1
Certification

Work History

Data Engineering (Nielsen Kastor )

Netesenz
12.2023 - Current
  • Collaborated with cross-functional teams to define requirements and develop robust data solutions.
  • Created documentation and training materials to facilitate knowledge transfer among colleagues regarding new initiatives or technologies implemented within the organization.
  • Developed scalable and maintainable data ingestion frameworks, resulting in streamlined data integration processes.
  • Improved data quality by implementing ETL processes and data cleansing techniques.

Software Engineer

EPAM Systems
05.2021 - 01.2023
  • Built a Elasticsearch-Kibana bases data ingestion and dashboard to analyze the SAST and DAST systems results
  • Written Data ingestion pipeline to ingest data from various SAST & DAST tools to Elasticsearch
  • Migrated more than 100 tables & stored procedures from RDS to Snowflake using PySpark & EMR Serverless
  • Performed various combinations of Spark test to optimizes data migration process
  • Written data ingestion pipeline to process stream data from API to RDS.
  • Build end to end Pipeline using Snowflake ,S3 and custom code to ingest data from On-Prem to Cloud on AWS.

Software Engineer

Edelman Financial Engines
10.2019 - 05.2021
  • Working with one off the fin-tech client on various machine learning and data engineering initiative
  • Prior to that helped a security company to move 40 billions of rows to AWS cloud from on premise
  • Converted various stored procedures into AWS Lambda to provide valuable insights
  • Responsible for writing EMR jobs to move MSSQL data to DynamoDB and then Redshift
  • Processing S3 data from various sources and storing them into AWS cloud
  • Developed automatic model training and deployment project using AWS Sage maker
  • Processing Custodian data using Spark and storing them in internal data warehouse.

Business Intelligence/ Data Engineering

Amazon Inc
03.2018 - 10.2019
  • I was part of Analytics and Insights (Amazon Advertising) team were involved in various in-house projects
  • Migrated MySQL database to DynamoDB database
  • Processed Terabytes of data in search of trend and value
  • Automated LBR process which helps more than 100 of AMM's to reduce LBR .ppt preparation from 24 hours to 3 minutes
  • Provided various reports and search impression to advertiser
  • Managed Amazon Big data analytical database Redshift
  • Developed various dashboard metrics using Tableau and Quicksight for stakeholder.

Senior Engineer

Juniper Networks
01.2015 - 01.2018
  • Created and maintained project CD portal with complete ownership
  • Talked to stakeholders and gathered requirements
  • Improved platform through a number of hits from 500 weekly users to 2k by redesigning APIs
  • Drove redesign of the consumer-facing website from Liferay to Django
  • Developed various dashboard metrics using Tableau and Sisense for the stakeholder.

Senior Engineer

G2| Xoriant Solutions
01.2014 - 01.2015
  • Xoriant is a software solution provider company based out to the USA
  • It provides software solution and product engineering services to its clients mainly in the area of Networking
  • Designed and coded application in an agile environment utilizing development approach between business, QA and development team
  • Built and led a team of 3 high performing engineers
  • Design, Develop, Guide and Motivate team members.

Senior Engineer

Happiest Minds
01.2013 - 01.2014
  • Developed the regain the client trust by delivering the project in less than schedule time
  • Designed and Developed a Face2face application with minimal supervision
  • Gained expertise in various languages and tools by developing an application in a very fast-paced environment
  • Developed POC for clients demos in a very short span of time
  • Utilized and explored various open source video streaming and online meeting platforms
  • Developed many dashboards for clients.

Education

B.E -

RGPV - Bhopal
01.2007 - 04.2011

Skills

Redshift, Data Pipeline, Data Processing

Snowflake

SQL

Spark

Elasticsearch

EMR

AWS

Glue

Quicksight,

Tableau

Kibana

Business intelligence

Certification

2017, 2018, Advance Programme In Data Science, IIM Calcutta, India

Additional Information - Publications Awards

Spot Award | Happiest Minds Technologies 2013

Software

Azure AZ-900 Certification

Timeline

Data Engineering (Nielsen Kastor )

Netesenz
12.2023 - Current

Software Engineer

EPAM Systems
05.2021 - 01.2023

Software Engineer

Edelman Financial Engines
10.2019 - 05.2021

Business Intelligence/ Data Engineering

Amazon Inc
03.2018 - 10.2019

Senior Engineer

Juniper Networks
01.2015 - 01.2018

Senior Engineer

G2| Xoriant Solutions
01.2014 - 01.2015

Senior Engineer

Happiest Minds
01.2013 - 01.2014

B.E -

RGPV - Bhopal
01.2007 - 04.2011

Similar Profiles

CREATE PROFILE
Rohit DubeyData & Business Intelligence Engineer