Summary
Overview
Work History
Education
Skills
Timeline
Generic

Surbhi Bansal

Senior Data Engineer
Delhi,

Summary

Experienced Data Engineer with 4 years of expertise in building and optimizing data pipelines using AWS, SQL, DBT, Python and PySpark. Specialized in large-scale data migration projects utilizing ETL/ELT tools and pipeline creation. Proven ability to mentor team members and optimize data pipelines, delivering high-quality results under tight deadlines while fostering collaboration and agile methodologies. Seeking a challenging opportunity to apply and expand expertise in innovative data engineering projects.

Overview

4
4
years of professional experience

Work History

Senior Data Engineer

ZS Associates
06.2024 - Current
  • Led multiple client requirement sessions, performing data profiling to generate business insights at global scale as well as implemented data modeling solutions tailored to business needs.
  • Designed and implemented pipelines on Airflow(ETL/ELT) and ensured that processing time has been reduced from hours to ~10 minutes.
  • Managed and maintained ingestion pipelines for diverse data sources, ensuring reliability and performance.
  • Designed and implemented scalable ELT solutions for both structured and unstructured data processing.
  • Ensured data quality through rigorous testing, validation, and monitoring of all data assets, minimizing inaccuracies and inconsistencies.
  • Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.
  • Championed the adoption of agile methodologies within the team, resulting in faster delivery times and increased collaboration among team members.
  • Participated in strategic planning sessions with stakeholders to assess business needs related to data engineering initiatives.
  • Delivered exceptional results under tight deadlines, consistently prioritizing tasks effectively to meet project timelines without compromising quality or accuracy.
  • Mentored multiple junior team members in best practices for code optimization, and troubleshooting techniques.
  • Proficient in using version control and documentation tools such as Git and Confluence.

Data Engineer

ZS Associates
06.2021 - 05.2024
  • Orchestrated the onboarding of database objects from global data warehousing systems to a cloud data lake on AWS , achieving a 20% improvement in data transfer and storage efficiency.
  • Developed and migrated multiple data pipelines from legacy systems to Redshift using ELT tool - DBT, resulting in enhanced data processing performance and scalability, with a 30% reduction in processing time.
  • Implemented Spark ETL jobs for data load from AWS S3 to AWS Redshift database using AWS Services (EMR, Glue, Athena, Airflow), implementing performance optimization techniques to streamline data transfer and processing, leading to a 35% reduction in processing time.
  • Applied optimization techniques to enhance data processing efficiency and performance, ensuring optimal performance and scalability across diverse datasets.
  • Developed and maintained robust data pipelines for affiliate datasets across APAC, LATAM, and EMEA regions, ensuring smooth deployment across all environments (DEV, TEST, UAT, PROD).
  • Created advanced SQL queries to support region-specific KPIs, with a focus on the LATAM region.
  • Performed root cause analysis by validating APAC dashboard metrics against multiple staged data layers to ensure data accuracy.
  • Provided operational support following production migrations, quickly identifying and resolving post-deployment issues.

Education

Bachelor of Technology - Computer Science Engineering

Maharaja Surajmal Institute of Technology
Delhi, India
04.2001 -

Class 12th -

Little Flowers Public Sr. Sec. School
Delhi, India
04.2001 -

Class 10th -

D.A.V. Public School
Delhi, India
04.2001 -

Skills

SQL

PySpark

AWS (S3/EMR/Glue/Airflow/Athena/Redshift)

DBT (ELT)

Python Programming

Git, Github

Databricks

Timeline

Senior Data Engineer

ZS Associates
06.2024 - Current

Data Engineer

ZS Associates
06.2021 - 05.2024

Bachelor of Technology - Computer Science Engineering

Maharaja Surajmal Institute of Technology
04.2001 -

Class 12th -

Little Flowers Public Sr. Sec. School
04.2001 -

Class 10th -

D.A.V. Public School
04.2001 -

Similar Profiles

CREATE PROFILE
Surbhi BansalSenior Data Engineer