Summary
Overview
Work History
Education
Skills
Certifications & Awards
Timeline
Generic

Stuti Mishra

Lead Big Data Engineer
Pune

Summary

Experienced lead data engineer with 8+ years of experience with expertise in Data Analytics, Data modelling and Data Engineering along with Cloud technologies (AWS, GCP, and Big Data platforms). Proven problem-solving, strategic decision-making, and effective communication. Expertise in client interactions, team management, project planning and managed end-to-end data analytics and data engineering projects in various domains such as Banking, Pharmaceutical, and Martech. Seeking a role in an organization to apply my data engineering skills and address complex data issues globally.


Overview

8
8
years of professional experience
7
7
years of post-secondary education

Work History

Lead - Data Engineering

Coditas Technology
07.2022 - Current

Led multiple projects as a data science team member, contributing to robust Data Warehouses, Data Lakes and Data Marts, optimizing storage and enhancing data integrations across AWS and GCP.

Roles and Responsibilities:

  • Led design of EDW for Fintech and MarTech clients, ensuring seamless integration and accessibility.
  • Developed APIs using API gateways and server less applications with Lambda/Cloud Functions.
  • Utilized AWS, GCP, Python, PySpark and SQL for efficient data pipelines and parallel processing.
  • Worked on streaming data APIs/events, capturing data from Google/Meta ads or mobile apps using Pub Sub or Kafka.
  • Executed large-scale data deployment and troubleshooting with Jenkins and CI/CD pipelines.
  • Leading a initiative to implement MLOps for a machine learning scenario, covering aspects from data drift to performance metrics where model is developed using GCP's Vertex AI.
  • Engaged in a POC to implement Data Lakehouse on Databricks to explore Lakehouse potential over traditional DW.


Data Migration Projects:

  • Implemented large-scale on-premise to cloud data migration.
  • Utilized Kafka consumers and event-driven pipelines with Glue jobs, Lambda, and Step Functions for entity-wise data transfer.
  • Executed deployment, troubleshooting, and reconciliation reports for granular data quality checks, preventing customer/account data discrepancies.

Senior Data Engineer/Technology Consultant

ZS Associates
01.2020 - 07.2022
  • Designed and developed comprehensive MDM solution on Reltio for structured and semi-structured data from diverse (70+) sources.
  • Utilized technologies such as Reltio, SPARK-SQL, HIVE, AWS EMR, S3, EC2, Unix Shell scripting, Azkaban, Python, and JSON.
  • Led/mentored team of 5, managing project from inception to completion.
  • Collaborated with clients to implement process addressing complex business use cases and capturing sales volume on Qlik sense dashboards/reports.

Business Technology Analyst

ZS Associates
02.2018 - 01.2020
  • Implemented MDM on Reltio, emphasizing on L3 Configuration, Match rules, Reference Data Management.
  • Managed data profiling, solution design, system integration, effort estimation, RFPs, and daily team activities.
  • Engaged in client-facing roles, collaborated with onsite/offshore teams, and developed Data Change Request Application.

Programmer Analyst

Cognizant Technology Solutions
12.2015 - 02.2018
  • Completed projects across entire DW development lifecycle, including requirements, testing, analysis, implementation, and support.
  • Proficient in Data Stage and Informatica development, utilizing various transformations (Expression, Aggregator, Joiner, Update Strategy, etc.) for data manipulation.
  • Worked with Oracle, DB2, Unix Shell scripting, and AWK in technology stack.

Education

Bachelor of Technology - Computer Science

Galgotias University
New Delhi
08.2011 - 06.2015

HSC - Physics, Chemistry, Maths

Navayug Radiance
Lucknow
04.2009 - 03.2011

SSC -

Navayug Radiance
Lucknow
04.2008 - 03.2009

Skills

    AWS services (Glue, Lambda, S3, API Gateway, etc)

undefined

Certifications & Awards

  • Professional Scrum Master Certified
  • Pursuing AWS Certified Solution Architect and GCP Professional Data Engineer
  • Two times ‘Ten on Ten’ awards in ZS Associates
  • Special Mention Project Champion Award 2018: Client Impact with ZS Associates
  • AVM SPOT award (Q2 2017)
  • Pat on the Back (Q1 2017)
  • Cognizant Certified in ANSI SQL and Informatica v9.0

Timeline

Lead - Data Engineering

Coditas Technology
07.2022 - Current

Senior Data Engineer/Technology Consultant

ZS Associates
01.2020 - 07.2022

Business Technology Analyst

ZS Associates
02.2018 - 01.2020

Programmer Analyst

Cognizant Technology Solutions
12.2015 - 02.2018

Bachelor of Technology - Computer Science

Galgotias University
08.2011 - 06.2015

HSC - Physics, Chemistry, Maths

Navayug Radiance
04.2009 - 03.2011

SSC -

Navayug Radiance
04.2008 - 03.2009
Stuti MishraLead Big Data Engineer