Summary
Overview
Work History
Education
Skills
Projects
Personal Information
Websites
Timeline
Generic
Shubham Kulkarni

Shubham Kulkarni

Pune

Summary

Dynamic Data Engineer with a proven track record at MasterCard, specializing in Spark and SQL for optimizing ETL processes. Adept at developing robust data pipelines and enhancing data quality, I excel in collaborative environments, driving performance improvements and delivering impactful solutions. Passionate about leveraging cloud technologies to transform data into actionable insights. Innovative Big Data Engineer known for high productivity and efficiency in task completion. Possess specialized skills in Hadoop ecosystem, Spark programming, and data modeling that contribute to solving complex data challenges. Excel in analytical thinking, problem-solving, and communication, leveraging these soft skills to effectively collaborate with cross-functional teams and deliver insightful data solutions.

Overview

5
5
years of professional experience

Work History

Data Engineer

MasterCard
Pune
09.2024 - Current
  • Optimized Spark jobs for improved performance, scalability, and reliability.
  • Developed dynamic web applications using Django and RESTful APIs.
  • Developed complex SQL queries to extract and manipulate data effectively.
  • Created detailed documentation for database structures and processes used in projects.
  • Assisted in troubleshooting and resolving issues in Spark applications and frameworks.
  • Created Hive tables, optimized queries, stored procedures, functions and views on Hadoop clusters.
  • Developed and maintained ETL processes for data extraction and transformation.
  • Implemented data quality checks to ensure accuracy and consistency.

Data Engineer

AMERICAN EXPRESS
Gurugram
09.2023 - 09.2024
  • Developed data processing applications using Apache Spark for large datasets.
  • Collaborated with data engineers to optimize ETL processes and improve performance.
  • Implemented Spark SQL queries to analyze structured and unstructured data efficiently.
  • Participated in code reviews and provided feedback to enhance code quality.
  • Developed and maintained Python applications for data processing and automation tasks.

Data Engineer

Genetech Software Solutions pvt ltd
Hyderabad
07.2020 - 08.2023
  • Developed data pipelines for efficient data processing and storage solutions.
  • Collaborated with data scientists to optimize algorithms and enhance model performance.
  • Implemented ETL processes using Apache Spark and Hadoop frameworks effectively.
  • Maintained and monitored data architecture to ensure reliability and performance.

Education

B.Tech/B.E. -

Pune University
01.2019

Skills

  • Spark
  • Database management using SQL
  • Python
  • Hadoop
  • Aws
  • Hive
  • Google Cloud Platform expertise
  • Portresses - Sql
  • Spark - Sql
  • Aws Glue
  • Sisense analytics expertise
  • PySpark development
  • Data Warehousing
  • Data Modeling
  • ETL process optimization
  • Spark job tuning
  • ETL development
  • ETL
  • Redshift AWS
  • AWS Glue
  • Technical Skills
  • Postgresql

Projects

Electrical Vehicle Charging, Innovative electric vehicle charging project for IT students, focusing on developing a smart charging system. Integrating IoT and mobile app technologies, students will create a user-friendly interface, real-time monitoring, and energy optimization features. The project aims to contribute to sustainable transportation solutions while honing IT skills.

Personal Information

  • Date of Birth: 11/12/97
  • Gender: Male
  • Marital Status: Single / unmarried

Websites

Timeline

Data Engineer

MasterCard
09.2024 - Current

Data Engineer

AMERICAN EXPRESS
09.2023 - 09.2024

Data Engineer

Genetech Software Solutions pvt ltd
07.2020 - 08.2023

B.Tech/B.E. -

Pune University

Similar Profiles

CREATE PROFILE
Shubham Kulkarni