Mayank Gupta
Ghaziabad
Summary
Data Engineer at Harman Connected Services, specializing in scalable data pipeline development with Python and SQL. Skilled in GCP and microservices, driving system performance, and operational efficiency. Agile practitioner dedicated to mentoring teams and delivering impactful data solutions.
Overview
6
6
years of professional experience
1
1
Certification
Work History
Data Engineer
Harman Connected Services
Bangalore
08.2022 - Current
- Designed and implemented microservices to facilitate vendor collaboration for ADAS data, ensuring a scalable architecture and strong data consistency.
- Led a team of five engineers to develop a workflow management system that automated data exchange with external vendors for 3D annotation workflows, supporting ADAS.
- Engineered scalable data pipelines using Python, Flyte, and SQL, improving data ingestion and transformation efficiency across annotation and analytics platforms.
- Architected a high-throughput export pipeline handling over 10 TB of autonomous driving data daily; developed RESTful microservices using FastAPI, GKE, PostgreSQL, and Flyte.
- Developed an automated annotation platform, leveraging HRNet-based computer vision models, reducing manual effort by up to 70%.
- Mentored junior engineers, and promoted best practices in data engineering, system design, and agile development.
- Tech Stack: Python, FastAPI, Django, SQL, PostgreSQL, MongoDB, Docker, Flyte, GCP, GKE, GCS Buckets, and GitLab.
Project Engineer
Wipro Limited
Bangalore
06.2019 - 08.2022
- Developed new Python modules and automated existing scripts, significantly enhancing operational efficiency.
- Reduced application processing time by designing and documenting optimized build and testing solutions.
- Created comprehensive solution documentation for seamless adoption by development and testing teams.
- Developed a Python, SQL, and PyQt tool that reduced CSV data import time from 5 hours to 5 minutes by automating database ingestion and registry reading.
- Created a Python-based backend and frontend tool to verify system prerequisites—services, ports, Windows features, registry—and automate the installation of missing components using PyQt.
- Built a Flask and React web application to parse YAML data with real-time validation, unique ID generation, and change tracking for YAML directories.
Education
Bachelor of Technology -
Meerut Institute of Engineering and Technology
Meerut01.2019
Senior Secondary School -
ST R C Scientific Convent School
Shamli01.2015
Higher Secondary School -
ST R C Scientific Convent School
Shamli01.2014
Skills
- Python
- FastAPI
- Flask
- Django
- SQL Server
- Postgres
- MongoDB
- GCP (Google Cloud Platform)
- docker
- Flyte
- Git
- Agile methodology
- Linux
- Rest API
Hobbies and Interests
- Playing badminton and chess
- Listening to music
Certification
- Udemy: Python, solid principles, and top design patterns
- Udemy: Google Cloud Platform for Beginners
Languages
Hindi
First Language
English
Proficient (C2)
C2
Timeline
Data Engineer
Harman Connected Services
08.2022 - Current
Project Engineer
Wipro Limited
06.2019 - 08.2022
Bachelor of Technology -
Meerut Institute of Engineering and Technology
Senior Secondary School -
ST R C Scientific Convent School
Higher Secondary School -
ST R C Scientific Convent School
Similar Profiles
Charan ReddyCharan Reddy
Software Development Engineer at Harman Connected ServicesSoftware Development Engineer at Harman Connected Services
Rohith Kumar ChinthalaRohith Kumar Chinthala
Senior Consultant at HARMAN Connected Services Pvt Ltd.Senior Consultant at HARMAN Connected Services Pvt Ltd.
Prakash PalanivelPrakash Palanivel
IT Engineer | Technical support at Harman Connected services Pvt Ltd (Mindsquare Technologies Pvt ltd)IT Engineer | Technical support at Harman Connected services Pvt Ltd (Mindsquare Technologies Pvt ltd)
AMIT GUPTAAMIT GUPTA
Senior Manager - Agile Program Management at Publicis SapientSenior Manager - Agile Program Management at Publicis Sapient
Sushma RaniSushma Rani
Survey Programmer at Excavate Research & Analysis Pvt. Ltd.Survey Programmer at Excavate Research & Analysis Pvt. Ltd.