Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic
Vibhor Bansal

Vibhor Bansal

Noida

Summary

Skilled Data Engineer with over 3 years of experience in designing and implementing data ingestion pipelines, data warehousing, and ETL processes. Adept at leveraging technologies such as Java, Python, Snowflake, MongoDB, Spark, Kafka, Airflow, Airbyte, Azure. Proven ability to manage and optimize large-scale data workflows, maintain code quality, and deploy robust data solutions in production environments.

Overview

3
3
years of professional experience
1
1
Certification

Work History

Associate Software Engineer II

Optum
Noida
03.2022 - Current
  • Developed data pipelines for ingesting data from PostgreSQL to Snowflake using Airbyte and Airflow.
  • Implemented data transformations and stored the processed data in Snowflake.
  • Worked on Java Based Cumulo framework to push data from source systems to Snowflake.
  • Ensured code quality and security by maintaining SonarQube gates and fixing vulnerabilities.
  • Managed deployments using Jenkins and later transitioned to Argo CD for production deployments.
  • Created reconciliation jobs and dashboards in Grafana for monitoring and troubleshooting data workflows.
  • Built and maintained high-volume data ingestion processes, ensuring data quality and system reliability.

Projects -

Data Pipeline Project for Ingesting Data from PostgreSQL to Snowflake and MongoDB

  • Designed and implemented a robust data pipeline using Airbyte and Airflow.
  • Automated data ingestion and transformation processes, ensuring timely and accurate data availability.
  • Created Alerting service to send an email alert in case of Airbyte Job Sync

Spring Boot Application for Data Ingestion

  • Worked on a Java application to push data from source systems to Snowflake and updating foundation layer using CDC Techniques ensuring latest event.
  • Ensured code quality and security, and managed deployments using Jenkins and Argo CD.

Apprentice Trainee

Bank of America
Chennai
07.2021 - 03.2022
  • Provided production support for data migration processes, handling batch file transfers between servers.
  • Collaborated with cross-functional teams to ensure seamless data flow and system uptime.

Education

B.Tech | Software Engineering -

SRM Institute of Science And Technology - Kattankulathur Campus
05-2021

CLASS XII -

Maharaja Agrasen Public School
01.2017

CLASS X -

Maharaja Agrasen Public School
01.2015

Skills

  • Programming Languages: Java, Python
  • Data Warehousing: Snowflake, MongoDB
  • Data Streaming: Kafka
  • ETL Tools: Airbyte, Apache Airflow
  • Cloud Platforms: Azure
  • CI/CD: Jenkins, Argo CD
  • Monitoring Tools: Grafana, Splunk
  • Others: SonarQube, Data Testing, Defect Management

Certification

  • AZ 900 Microsoft Azure Fundamentals
  • Airflow and Airbyte
  • Data Warehouse Fundamentals
  • How to build Chatbot using IBM Watson, IBM
  • AWS Fundamentals: Going Cloud-Native, Coursera
  • Mastering Data Structures and Algorithms, Udemy
  • Python 3, Coursera

Timeline

Associate Software Engineer II

Optum
03.2022 - Current

Apprentice Trainee

Bank of America
07.2021 - 03.2022

B.Tech | Software Engineering -

SRM Institute of Science And Technology - Kattankulathur Campus

CLASS XII -

Maharaja Agrasen Public School

CLASS X -

Maharaja Agrasen Public School
Vibhor Bansal