Kumar Shubham

Experienced Data Professional with 3+ years of successful data solution delivery. Strong team player with a passion for continuous learning and utilizing cutting-edge technologies to extract valuable insights from data.

Title: Data Engineer | Data Analyst

Data Ingestion Pipeline Development:

• Collaborated in a cross-functional team to design and implement a data ingestion pipeline responsible for fetching and storing incremental data from the client application source to a centralized data lake.
• Leveraged AWS services (S3, Lambda, Redshift) for efficient, secure, and scalable data transfer, transformation, and storage.
• Developed expertise in data architecture and AWS services, contributing to the creation of reliable data pipelines using MySQL, Python and PySpark.
• Enhanced pipeline efficiency, resulting in a 25% reduction in data transfer latency.

Data Testing and Analysis:

• Conducted comprehensive testing and analysis of incoming data post the successful deployment of the data pipeline.
• Utilized SQL for data querying and manipulation, ensuring accuracy, consistency, and completeness.
• Extracted actionable insights from data, contributing valuable information for informed decision-making.

Proof of Concepts (POC):

• Managed various client and internal POCs, showcasing adaptability and rapid learning.
• Successfully explored, developed, and implemented solutions using AWS services like Redshift, Lambda, Glue, IAM, Athena, and Databricks.
• Proposed a high-impact POC that resulted in the adoption of AWS Glue and Redshift for data transformation, improving overall pipeline efficiency.

• DP-900: Azure Data Fundamentals, 06/2023 - Present, Microsoft
• Databricks Lakehouse Fundamentals, 09/2022, Databricks
• Generative AI Fundamentals, 07/2023, Databricks

• Video Gaming
• Photography
• Travelling
• Blogging

• English
• Hindi