Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

SHUBHAM MITTAL

Bangalore

Summary

Experienced Data Engineer with 3 years of hands-on expertise in creating production-grade data solutions using modern technologies. Proficient in Python, SQL, and Spark for constructing complex ETL pipelines. Skilled in integrating data products into microservices for enhanced analytics and customer features. AWS cloud proficiency. Holds a degree in Information Science. Strong problem-solving skills and a collaborative team player.

Overview

4
4
years of professional experience
1
1
Certificate

Work History

Data Engineer II

Media IQ Digital
Bangalore
10.2023 - Current
  • I currently lead a team of 2-4 Data Engineers focused on building a scalable Feature Store to support machine learning workflows. I also oversee technical teams in MLOps, ensuring seamless integration between data pipelines and machine learning operations. My role involves guiding architecture design, development, and collaborating with cross-functional teams to enable efficient model deployment and feature engineering.

Data Engineer I

Media IQ Digital
Bangalore
07.2021 - 09.2023
  • Work directly with analysts, data scientists, product owners, and business experts in a cross-functional, agile, software development team
  • Developed and optimised data activation pipelines for multiple DSPs, leveraging automation to streamline data collection and reporting processes
  • Designed and implemented an email alert system to detect campaign anomalies in real-time, enabling timely and proactive response to issues
  • Utilised SQL queries to build comprehensive and visually engaging dashboards, providing critical business to stakeholders in a timely and effective manner
  • Wrote multiple automation jobs to fetch data and reports from multiple DSP's, increasing efficiency and accuracy of data collection and analysis
  • Proficient in executing ETL operations with expertise in Spark and Hive
  • Well-versed in Spark SQL for effective querying and data manipulation
  • Experienced in utilizing Amazon Web Services (AWS) for scalable and reliable data solutions
  • Creating backend of Tableau Dashboards
  • Responsible for connecting third-party data sources to extract insights
  • And Activating insights in high-performance campaigns for tangible business outcomes
  • Demonstrated proficiency in modern programming languages, including Python and SQL, to ensure efficient data processing and analysis.

Data Engineer Intern

Media IQ Digital
Bangalore
01.2021 - 06.2021
  • Demonstrated proficiency in leveraging Zapier to extract and process data from internal support channels, improvising accuracy and accessibility
  • Collaborated with multiple teams simultaneously to provide comprehensive support for multiple dashboards, ensuring timely and effective data reporting and analysis
  • Assisted the team in migrating the workflows from Qubole to Databricks, resulting in increased efficiency and streamlined process
  • Creating back end data sets for various dashboard hosted on Tableau
  • Managed lifecycle elements of ETL development, from robust testing to final development.

Education

B.E. (Information Science) -

JSSS&TU
Mysore, KA
06.2021

Class X11 -

S R Public School
Kota, RJ
01.2017

Skills

  • Python
  • Pyspark
  • SQL
  • Sparksql
  • Amazon Web Services (AWS)
  • Databricks
  • Qubole
  • Complex ETL Pipelines
  • Batch Processing
  • Pandas
  • Tableau
  • MySQL

Certification

  • Python (Basics), HackerRank
  • Object Detection with OpenCV and Python (Computer Vision), Coursera
  • Image Basics with OpenCV and Python (Computer Vision), Coursera
  • Development on AWS, AWS

Timeline

Data Engineer II

Media IQ Digital
10.2023 - Current

Data Engineer I

Media IQ Digital
07.2021 - 09.2023

Data Engineer Intern

Media IQ Digital
01.2021 - 06.2021

B.E. (Information Science) -

JSSS&TU

Class X11 -

S R Public School

Similar Profiles

CREATE PROFILE
SHUBHAM MITTAL