Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic
Surbhi Singh

Surbhi Singh

Senior Data Engineer
Gurgaon

Summary

Lead Data Engineer with 9+ years of experience building and scaling data platforms, driving cloud-based architecture, and leading cross-functional teams. Proven track record in leading data engineering initiatives across global organizations including Gartner and Accenture. Expertise in real-time data streaming, large-scale ETL, and cloud solutions (AWS & Azure). Passionate about driving business value through clean, efficient, and reliable data solutions.

Overview

9
9
years of professional experience
2
2
Certifications

Work History

Senior Data Engineer

Gartner
11.2022 - Current
  • Led a team of 4–6 engineers as technical project lead, delivering high-impact features for Gartner’s AI-powered search capability.
  • Defined product vision, roadmap, and KPIs for search functionality and AI enhancements.
  • Implemented A/B testing framework, increasing client engagement through data-driven decisions.
  • Architected and deployed scalable data pipeline frameworks using AWS and PySpark.
  • Advocated for best practices in search and AI across engineering and product teams.
  • Delivered exceptional results under tight deadlines, consistently prioritizing tasks effectively to meet project timelines without compromising quality or accuracy.

Senior Data Engineer

Dunnhumby India Pvt Ltd
07.2021 - 11.2022
  • Developed ETL pipelines to evaluate retail recommendation engines across multiple campaigns.
  • Built KPI dashboards and data quality checks to monitor offer effectiveness and campaign ROI.
  • Partnered with cross-functional teams to design and deploy production-grade data flows.
  • Designed scalable database solutions and optimized performance for fast analytical processing.
  • Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.

Senior Data Analytics Engineer

Gartner Inc
10.2019 - 07.2021
  • Built and automated ETL pipelines across Azure and AWS to support resume scoring at scale (~1M+ resumes, 200+ KPIs).
  • Improved pipeline performance by 10x by replacing pandas with Spark and implementing multithreading.
  • Migrated 1700+ data sources into unified data lake using PySpark, Azure Data Factory, and Synapse Analytics.
  • Reduced defects and rerun incidents by 25% through implementation of robust validation systems.

Application Development Analyst

Accenture
05.2016 - 09.2019
  • Built and optimized data ingestion frameworks using Sqoop, Spark, Hive, and Oozie for Hadoop-based systems.
  • Achieved 1000% improvement in data ingestion efficiency via Spark migration and performance tuning

Education

B.tech - Computer Science

KIIT University
05.2016

Skills

  • Core Competencies
    Cloud Platforms: AWS (S3, EC2, EMR, Lambda, Glue, Kinesis), Azure (ADF, Synapse, Databricks)
    Big Data & Streaming: Apache Spark (SQL, Streaming), Hadoop, Kafka, Kinesis
    Programming & Tools: Python, SQL, PySpark, Terraform, Docker, Git
    Data Engineering: ETL Pipelines, Data Lakes, Data Warehousing, Data Quality
    Leadership: Project Ownership, Team Mentoring, Stakeholder Management
    Analytics & AI: NLP, ML Integration, KPI Engineering, A/B Testing

Certification

DP-201 Designing an Azure Data Solution

Timeline

Senior Data Engineer

Gartner
11.2022 - Current

Senior Data Engineer

Dunnhumby India Pvt Ltd
07.2021 - 11.2022

DP-201 Designing an Azure Data Solution

01-2021

DP-200 Implementing an Azure Data Solution

01-2021

Senior Data Analytics Engineer

Gartner Inc
10.2019 - 07.2021

Application Development Analyst

Accenture
05.2016 - 09.2019

B.tech - Computer Science

KIIT University

Similar Profiles

CREATE PROFILE
Surbhi SinghSenior Data Engineer