Vipul Singhal
Gurgaon
Summary
Motivated Team Lead possessing excellent leadership and planning abilities. Focused on delivering high-quality products on tight schedules. Monitors, trains, and encourages employees to improve skills and meet demanding targets. History of successfully developing and managing strong teams through proactive training and issue management.
Overview
7
7
years of professional experience
Work History
Team Lead
Blinkit
Gurgaon
04.2024 - Current
- Led a team of 4 engineers and developed a customer-facing application using Django, enhancing user experience and operational efficiency.
- Optimized workflow jobs by migrating heavy-load processes from Airflow to Apache Spark, achieving a significant runtime reduction from 4 hours to 45 minutes.
- Designed and implemented an in-house microservice for document digitization, enabling seamless data extraction and processing. This eliminated dependency on third-party vendors, significantly reducing costs, while accommodating custom use cases effectively.
Senior Software Engineer
Myntra
BANGALORE
04.2022 - 03.2024
- Worked on building a self serve data platform that ingests data from various MySQL , NoSQL(Mongo, Cassandra), API, Google sheets and builds data pipeline all the way through to data lake(Hive powered HDFS storage).
- Led the development and implementation of efficient data pipelines with the use of Debezium and Mongo source connectors, Kafka, Kafka connect, Azure Blob, Spark among others resulting in a ~30% decrease in latency and ~40% increase in throughput in data accessibility.
- Automated monthly data purge processes through Azure Data Blob and Azure Data Factory, resulting in decreased storage costs of 25%.
- Established design parameters for existing data pipelines to incorporate new features like schema evolution and schema enforcement in NoSQL databases.
Software Engineer
Teikametrics
BANGALORE
05.2020 - 04.2022
- Migrated the legacy ETL pipelines to near real time stream processing via spark jobs in delta tables serving around 50 TB's of data to the end customer.
- Responsible for the CI/CD pipelining for the transformations via terraform and AWS
- Worked on getting bulk data from various e-commerce channels like Amazon, Walmart, Ebay etc and making sure of asynchronous publishing and consumption via Kafka and RabbitMQ.
- Optimized the job run in spark from 4 hrs to 30 mins. for processing of 100 GB data.
Software Engineer
Haplo Health
DELHI
01.2018 - 04.2020
- Worked on customization/enhancement and development of the Haplohealth website.
- Worked on API for the new token-based authentication system. It requires authentication with the JWT tokenization using Django and DRF.
- Added API validations to the existing APIs and all the above services were deployed as Microservices.
- Attended various incubators and pitching events and helped in designing the strategy about the product and sales projections.
Education
Bachelor of Science - Electronics and Communication
Institute of Engineering and Technology
Skills
- Python, Scala
- Kafka
- Spark,
- Debezium
- Grafana
- Databricks(Delta tables)
- Redis
- Celery
- Airflow
Timeline
Team Lead
Blinkit
04.2024 - Current
Senior Software Engineer
Myntra
04.2022 - 03.2024
Software Engineer
Teikametrics
05.2020 - 04.2022
Software Engineer
Haplo Health
01.2018 - 04.2020
Bachelor of Science - Electronics and Communication
Institute of Engineering and Technology
Similar Profiles
Amit WagheAmit Waghe
Senior Executive at BlinkitSenior Executive at Blinkit
Kunal SethiKunal Sethi
City Lead | Bistro by Blinkit at BlinkitCity Lead | Bistro by Blinkit at Blinkit
Jill DaveJill Dave
Delivery Driver at BlinkitDelivery Driver at Blinkit