Chirag Bansal
Noida
Summary
Senior Data Engineer with 10+ years of experience in Apache Kafka and real-time data processing, along with quality assurance for front-end and back-end automation. Proven ability to set up Kafka clusters and optimize data ingestion pipelines for enhanced performance. Dynamic professional skilled in real-time data ingestion and automation. Experienced in leveraging Kafka Streams and KSQL for data transformation, contributing to improved data workflows and operational efficiency.
Overview
12
12
years of professional experience
Work History
Senior Data Engineer
S&P Global India
Noida
03.2023 - Current
- Kafka Connect cluster setup to leverage the Postgres connector in the data ingestion pipeline.
- Hands-on experience in creating the Avro schemas and JSON schemas.
- Closely worked with the Kafka Admin team to set up the Kafka cluster, using the languages English and Hindi, in the QA environments.
- Using Kafka Streams to process real time data
Senior Software Engineer
Pure Software India Pvt Ltd
Noida
02.2020 - 12.2022
- Creating KSQL queries for data transformation.
- Deduplication of records using Kafka KSQL queries.
- Kafka cluster deployment and monitoring.
Data Engineer
One97 Communications Ltd.
Noida
11.2018 - 01.2020
- Designed and developed distributed systems leveraging Apache Kafka and other technologies.
- Integrated various third-party APIs into existing infrastructure components via RESTful services or message queues like Kafka and RabbitMQ .
- Created a middleware with GoReplay traffic replication using Kafka as a pub-sub model.
Senior SDET Engineer
Xavient Information Systems
Noida
04.2016 - 10.2018
- Automation test framework development and maintenance.
- Tools and utilities development for task automation.
SDET
Nirvana Solutions India
Guragon
11.2013 - 03.2016
- Developed automated test scripts using Selenium and Java for web applications.
- API automation suite development with Rest Assured.
Education
Post Graduate Diploma - Machine Learning & Artificial Intelligence
IIITB
Banglore06-2022
B. Tech. - Information Technology
GJU S&T
Hisar, Haryana08-2013
Skills
- Apache/Confluent Kafka
- Kafka Connect
- Kafka streams
- Schema Registry
- KsqlDB
- Postgres
- Java
- Python
- Selenium
- API Integration & Automation
Timeline
Senior Data Engineer
S&P Global India
03.2023 - Current
Senior Software Engineer
Pure Software India Pvt Ltd
02.2020 - 12.2022
Data Engineer
One97 Communications Ltd.
11.2018 - 01.2020
Senior SDET Engineer
Xavient Information Systems
04.2016 - 10.2018
SDET
Nirvana Solutions India
11.2013 - 03.2016
Post Graduate Diploma - Machine Learning & Artificial Intelligence
IIITB
B. Tech. - Information Technology
GJU S&T
Similar Profiles
Rahul GalaRahul Gala
Senior Executive IT at Brueckner Group India Pvt Ltd (Formerly Known as Packsys Global India)Senior Executive IT at Brueckner Group India Pvt Ltd (Formerly Known as Packsys Global India)
Amjad KhanAmjad Khan
Senior Program Manager at Magnit Global Pvt Ltd (Former PRO Unlimited Global India Pvt Ltd)Senior Program Manager at Magnit Global Pvt Ltd (Former PRO Unlimited Global India Pvt Ltd)
Sandeep KushwahaSandeep Kushwaha
Senior Associate at Optum Global (India) solution India PVT. LTD.Senior Associate at Optum Global (India) solution India PVT. LTD.
Pinky AhlawatPinky Ahlawat
HR Administrative Assistant at LINTL Clothing Pvt. Ltd.HR Administrative Assistant at LINTL Clothing Pvt. Ltd.
Sahil ShrivastavaSahil Shrivastava
Technical Lead Engineer at Perfios Software Solutions Pvt LtdTechnical Lead Engineer at Perfios Software Solutions Pvt Ltd