Dheeraj Pimoli
Haldwani
Summary
Adept at leveraging Big Data and PySpark for transformative solutions, I significantly enhanced data transfer efficiency by 25% at BNED LoudCloud. My expertise in AWS and Python, combined with a knack for innovative problem-solving, drove the success of critical projects. Demonstrated leadership in developing and deploying automated systems showcases my blend of technical prowess and strategic thinking.
Overview
3
3
years of professional experience
1
1
Certification
Work History
Data Engineer
BNED LoudCloud
Mumbai
12.2021 - Current
- Played a pivotal role in the Helix Project, delivering a hyper-personalized, and hyper-local shopping experience critical to its success.
- Optimized ETL workflows using PySpark, enhancing data transfer efficiency by 25%.
- Generated insightful reports through the Enterprise Data Warehouse, empowering teams with actionable analytics.
- Developed and deployed automated reports that replaced legacy Cognos, slashing generation time by 97% (from 30 minutes to 1 minute) using PostgreSQL, PySpark, AWS Glue and AWS Lambda.
- Automated data loading from multiple sources with Python scripts, streamlining data entry into a centralized system.
- Designed and implemented data pipelines for ingesting, storing, and processing large datasets with Apache Spark and Hive.
- Innovated storage and access strategies for data, in line with evolving technology standards.
- Monitored databases and systems to ensure optimized performance across all operations.
Full Stack Software Developer
NIIT Limited
07.2021 - 11.2021
- Played a key role in developing the JukeBox Project backend, enabling users to stream, download, and create personalized playlists
- Built and integrated multiple microservices using Java Core, Spring Hibernate, and SQL through an API gateway
- Ensured a scalable and efficient backend, contributing to a seamless user experience
Education
Bachelor of Engineering - BE - Mechanical Engineering
Rustamji Institute of Technology
Gwalior07.2019
Master of Science - Artificial Intelligence And Machine Learning
Scaler Neovarsity
OnlineSkills
- Big Data
- PySpark
- Numpy
- Java
- Python
- Data warehousing
- MongoDB
- Postgres
- Applied Mathematics
- AWS
- AWS Glue
- Athena
- S3
- Lambda
Accomplishments
- Consistently received the top performer ranking twice in a row at BNED LoudCloud
- Bronze medalist in Boxing at University level
Projects
Loan Tap, Developed a LoanTap application to assess the creditworthiness of potential borrowers, focusing on ensuring loans are given to those most likely to repay., Analyzed a dataset using various attributes, preparing the data for training and validation to enhance the accuracy of predictions., Implemented a Logistic Regression model, fitting it on the training data to predict borrower creditworthiness., Applied hyperparameter tuning techniques like Grid Search CV and Randomized Search CV to optimize model performance, adjusting parameters like regularization strength and penalty.
Hobbies and Interests
- Coding
- Current Affairs
- Defense
- Taekwondo
- Boxing
- Technology
Languages
- English, Full Professional Proficiency
- Hindi, Full Professional Proficiency
Certification
- The Complete Python Bootcamp From Zero to Hero in Python(Udemy Course) : ude.my/UC-49507b76-c942-45c0-b0e8-f72c4bd3d952
- Taming Big Data with Apache Spark and Python - Hands On! (Udemy Course) : ude.my/UC-3ba903fa-457d-4820-96c3-186cd1c6edb5
Timeline
Data Engineer
BNED LoudCloud
12.2021 - Current
Full Stack Software Developer
NIIT Limited
07.2021 - 11.2021
- The Complete Python Bootcamp From Zero to Hero in Python(Udemy Course) : ude.my/UC-49507b76-c942-45c0-b0e8-f72c4bd3d952
- Taming Big Data with Apache Spark and Python - Hands On! (Udemy Course) : ude.my/UC-3ba903fa-457d-4820-96c3-186cd1c6edb5
Bachelor of Engineering - BE - Mechanical Engineering
Rustamji Institute of Technology
Master of Science - Artificial Intelligence And Machine Learning
Scaler Neovarsity
Similar Profiles
Jay JoshiJay Joshi
Software Developer at LoudcloudSoftware Developer at Loudcloud
GARVIT PANDEGARVIT PANDE
Client Analyst at WiproClient Analyst at Wipro
Tanuja PandayTanuja Panday
Assistant Professor at Pal College of Technology and ManagementAssistant Professor at Pal College of Technology and Management