Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

HARSHIT SRIVASTAVA

Noida

Summary

Data Engineer with 3+ years of experience in designing and optimizing large-scale data pipelines using Azure Data Factory, Databricks (PySpark), Synapse Analytics, and Data Lake architectures. Proven track record in migrating on-premises systems to cloud-based lakehouses, implementing incremental ETL/ELT workflows, and ensuring high data reliability and performance. Strong foundation in .NET automation and API integrations, enabling end-to-end data solutions that drive business intelligence and analytics.

Overview

3
3
years of professional experience
1
1
Certification

Work History

Senior Software Engineer

Capgemini
Bangalore
03.2025 - Current
  • Company Overview: Bangalore, India
  • Designed and implemented end-to-end ETL pipelines using Azure Data Factory, integrating data from SQL Server, Blob Storage, and REST APIs.
  • Developed PySpark transformations in Azure Databricks for cleansing, joining, and aggregating large datasets.
  • Migrated legacy on-premises SQL Server data to Azure Data Lake with incremental load techniques, reducing refresh time by 40%.
  • Established a Bronze-Silver-Gold data architecture, optimizing query performance and storage efficiency.
  • Proactively monitored production pipelines, achieving 99.9% uptime.
  • Bangalore, India

Software Engineer

Capgemini
Bangalore
07.2023 - 07.2025
  • Company Overview: Bangalore, India
  • Built C#/.NET automation workflows for extracting, transforming, and loading structured data into SQL Server.
  • Developed API-based data ingestion pipelines, reducing manual intervention by 70%.
  • Automated recurring data reports with validation checks, improving reporting accuracy by 30%.
  • Partnered with cross-functional teams to integrate automation workflows into core business processes.
  • Bangalore, India

Associate Software Engineer

Capgemini
Bangalore
01.2023 - 07.2023
  • Company Overview: Bangalore, India
  • Contributed to ETL workflow development and data transformation logic in C#.
  • Assisted in building backend data integration services and validating outputs.
  • Participated in requirement analysis and testing for automation-related projects.
  • Bangalore, India

Associate Software Engineer

MAQ Software
Noida
10.2022 - 12.2022
  • Company Overview: Noida, India
  • Developed and executed automation test scripts using C# and .NET for a US-based client (CUDL).
  • Automated desktop and web application testing workflows, reducing manual QA effort by 40%.
  • Enhanced testing coverage by designing robust automation frameworks for key functional areas.
  • Noida, India

Education

Bachelor of Technology - Computer Science and Engineering

G.L Bajaj Institute of Technology And Management
Noida, UP
01.2023

Skills

  • Azure Data Factory and Databricks
  • Problem solving
  • Effective communication
  • Azure Synapse Analytics
  • Data Lake Storage (ADLS)
  • Event Hub
  • ETL/ELT pipelines
  • Data warehousing
  • Lakehouse architecture
  • Data modeling
  • Incremental loads
  • Data partitioning
  • Bronze-silver-gold layers
  • Streaming data
  • Python programming
  • SQL (T-SQL, Azure SQL)
  • C# and NET development
  • API integration
  • PySpark transformations
  • Azure DevOps and Git
  • Jupyter Notebooks and Visual Studio Code
  • Pipeline maintenance
  • Postman testing tools
  • Power BI basics

Certification

  • AZ - 900
  • Completed data engineering course
  • Solved more than 300 DSA problems across the platforms

Timeline

Senior Software Engineer

Capgemini
03.2025 - Current

Software Engineer

Capgemini
07.2023 - 07.2025

Associate Software Engineer

Capgemini
01.2023 - 07.2023

Associate Software Engineer

MAQ Software
10.2022 - 12.2022

Bachelor of Technology - Computer Science and Engineering

G.L Bajaj Institute of Technology And Management

Similar Profiles

CREATE PROFILE
HARSHIT SRIVASTAVA