Summary
Overview
Work History
Education
Skills
Timeline
Generic
Vipul Singhal

Vipul Singhal

Gurgaon

Summary

Motivated Team Lead possessing excellent leadership and planning abilities. Focused on delivering high-quality products on tight schedules. Monitors, trains, and encourages employees to improve skills and meet demanding targets. History of successfully developing and managing strong teams through proactive training and issue management.

Overview

7
7
years of professional experience

Work History

Team Lead

Blinkit
Gurgaon
04.2024 - Current
  • Led a team of 4 engineers and developed a customer-facing application using Django, enhancing user experience and operational efficiency.
  • Optimized workflow jobs by migrating heavy-load processes from Airflow to Apache Spark, achieving a significant runtime reduction from 4 hours to 45 minutes.
  • Designed and implemented an in-house microservice for document digitization, enabling seamless data extraction and processing. This eliminated dependency on third-party vendors, significantly reducing costs, while accommodating custom use cases effectively.

Senior Software Engineer

Myntra
BANGALORE
04.2022 - 03.2024
  • Worked on building a self serve data platform that ingests data from various MySQL , NoSQL(Mongo, Cassandra), API, Google sheets and builds data pipeline all the way through to data lake(Hive powered HDFS storage).
  • Led the development and implementation of efficient data pipelines with the use of Debezium and Mongo source connectors, Kafka, Kafka connect, Azure Blob, Spark among others resulting in a ~30% decrease in latency and ~40% increase in throughput in data accessibility.
  • Automated monthly data purge processes through Azure Data Blob and Azure Data Factory, resulting in decreased storage costs of 25%.
  • Established design parameters for existing data pipelines to incorporate new features like schema evolution and schema enforcement in NoSQL databases.

Software Engineer

Teikametrics
BANGALORE
05.2020 - 04.2022
  • Migrated the legacy ETL pipelines to near real time stream processing via spark jobs in delta tables serving around 50 TB's of data to the end customer.
  • Responsible for the CI/CD pipelining for the transformations via terraform and AWS
  • Worked on getting bulk data from various e-commerce channels like Amazon, Walmart, Ebay etc and making sure of asynchronous publishing and consumption via Kafka and RabbitMQ.
  • Optimized the job run in spark from 4 hrs to 30 mins. for processing of 100 GB data.

Software Engineer

Haplo Health
DELHI
01.2018 - 04.2020
  • Worked on customization/enhancement and development of the Haplohealth website.
  • Worked on API for the new token-based authentication system. It requires authentication with the JWT tokenization using Django and DRF.
  • Added API validations to the existing APIs and all the above services were deployed as Microservices.
  • Attended various incubators and pitching events and helped in designing the strategy about the product and sales projections.

Education

Bachelor of Science - Electronics and Communication

Institute of Engineering and Technology

Skills

  • Python, Scala
  • Kafka
  • Spark,
  • Debezium
  • Grafana
  • Databricks(Delta tables)
  • Redis
  • Celery
  • Airflow

Timeline

Team Lead

Blinkit
04.2024 - Current

Senior Software Engineer

Myntra
04.2022 - 03.2024

Software Engineer

Teikametrics
05.2020 - 04.2022

Software Engineer

Haplo Health
01.2018 - 04.2020

Bachelor of Science - Electronics and Communication

Institute of Engineering and Technology
Vipul Singhal