Summary
Overview
Work History
Education
Skills
Key Learnings
Achievements
Timeline
Generic
Lalit Upadhyay

Lalit Upadhyay

Data Engineer
Pune

Summary

Results-driven Data Engineering and ETL professional with over 9 years of experience in designing, building, and supporting robust enterprise data pipelines within the banking and consumer sectors. Strong expertise in Ab Initio, SQL, Unix shell scripting, and AWS, consistently delivering regulatory and business-critical programs with precision and timeliness. Proficient in end-to-end SDLC processes, fostering stakeholder collaboration, providing production support, and spearheading proof of concepts to enhance data quality, security, and delivery efficiency. Committed to leveraging technical skills and industry knowledge to drive impactful data solutions that align with organizational goals.

Overview

9
9
years of professional experience

Work History

Senior Data Engineer

Barclays
08.2022 - Current

Corporate DataLake / Financial Crime / KYC

Led and delivered enterprise data engineering solutions across regulatory reporting, transaction monitoring, and data lake initiatives using Ab Initio and AWS. Designed and developed scalable ETL pipelines, ensuring high data quality, governance, and compliance across multiple jurisdictions.

  • Gathered requirements, performed impact analysis, and designed scalable data solutions aligned with enterprise standards.
  • Developed complex Ab Initio graphs integrating multiple source systems, supporting regulatory reporting and transaction monitoring (Actimize).
  • Owned end-to-end SDLC including development, testing, deployment, and production support with zero-defect delivery.
  • Collaborated with cross-functional teams (BAs, DevOps, governance, upstream/downstream systems) to ensure seamless data integration and compliance.
  • Managed code migrations, release deployments, and production issue resolution.
  • Led technical problem-solving, resolved dependencies, and mentored junior team members.
  • Drove innovation through POCs, including on-prem data encryption using AWS KMS and PySpark.

Key Achievements:

  • Delivered multiple regulatory projects (Partner Banks, GIFT City, SFDC, MI reporting) on time with zero defects.
  • Ensured reliable data availability for transaction monitoring systems enabling accurate alert generation.
  • Led BVP migration for data lake, creating documentation that significantly reduced migration effort.
  • Successfully demonstrated data encryption POC with AWS KMS and PySpark to senior leadership.

Barclays
04.2023 - 07.2024
  • Barclays (TM – SAM8)
  • Project Description: Transaction Monitoring (Suspicious Activity Management) ETL team. Responsible for ensuring data availability for the Actimize team, which uses the data for alert generation across multiple jurisdictions.
  • Roles and Responsibilities:
  • Owned requirements analysis, Ab Initio development, and unit testing to ensure data availability for Actimize alert generation.
  • Managed code migrations and deployments across environments, and supported production releases and troubleshooting.
  • Tools and Technology: Ab Initio GDE, Metadata Hub, shell scripting, Oracle, Bitbucket, Jenkins, TWS, AutoSys, ServiceNow

Barclays
08.2022 - 03.2023
  • Barclays (JB2 - MI Canned Reports)
  • Project Description: Jet Bridge 2.0 facilitates the client journey, starting from onboarding and KYC refresh through ongoing maintenance. JB2 MI Canned Reports ensure the availability of regulatory, control, operational efficiency, and ad hoc reports.
  • Roles and Responsibility:
  • Quickly adapted to the new team and application and understood complex regulatory requirements.
  • Collaborated with BAs to finalize ever-changing requirements to deliver regulatory reports.
  • Developed AI graphs with complex logic, integrating two source systems with different granularities to generate the required reports.
  • Adhered to strict and challenging timelines, JB2 delivery was critical and high priority.
  • Supported QA testing alongside development activities which themselves were very strict in terms of timelines.
  • Tools and Technology: Ab Initio GDE, Shell Scripting, TWS

Senior Data Engineer

Larsen & Toubro Infotech
04.2021 - 07.2022

Allocation Processing and Settlement System

Worked on the Allocation Processing and Settlement System (APSS) ETL team, supporting data pipelines for the APSS dashboard.

  • Collaborated with Product Owners, Business Analysts, developers, and QA teams to ensure smooth delivery of enhancements.
  • Contributed to multiple critical system enhancements, ensuring timely and high-quality releases.
  • Managed parallel tasks across projects, quickly adapting to the application framework and business requirements.
  • Received client recognition for effectively handling multiple deliverables and demonstrating strong learning agility.

Data Engineer

IBM
06.2020 - 04.2021

Risk Finance & Treasury

Worked on risk data engineering solutions to support Capital & Impairment Models by ensuring seamless availability of breach and default-related data during the transition from legacy (BUK) to the new BI DoD system.

  • Designed and developed ETL processes to merge legacy (BUK) and new (BI DoD) customer data, ensuring uninterrupted data supply for risk and capital impairment models.
  • Built reusable and flexible data processing frameworks to handle single and multi-day data loads efficiently.
  • Developed shell scripts for job orchestration, preprocessing, date controls, and archival processes.
  • Executed end-to-end SDLC including requirement gathering, data profiling, development, testing, and production implementation.
  • Collaborated with business stakeholders and model owners to translate requirements into scalable data solutions.
  • Performed in-depth data analysis and profiling to ensure data quality and alignment with model requirements.

ETL Developer

Infosys
01.2017 - 06.2020

Consumer Cards & Payments

Worked on multiple data engineering initiatives in the consumer banking domain, including FDR Data Lake Ingestion, Client First Sales Reporting (CFSR), Dataline History Load, and DDR Tiering Remediation.

  • Built and enhanced Consumer Cards Data Mart and regulatory/business reports, ensuring accuracy and timely delivery.
  • Led end-to-end implementation of FDR source layout changes, including impact analysis, stakeholder communication, code updates, and downstream testing support.
  • Designed scalable ingestion and processing frameworks for mainframe datasets, enabling multi-day processing and supporting ~18 months of historical data loads.
  • Performed metadata validations to ensure data lineage integrity and compliance with governance standards; supported audits and documentation.
  • Collaborated with downstream teams for requirement gathering, change communication, and validation of data changes.
  • Identified and resolved data discrepancies (e.g., DDR tiering), proposing remediation strategies and driving stakeholder alignment.
  • Mentored new team members and supported onboarding through knowledge transfer on ingestion and reconciliation frameworks.

Education

Bachelor of Technology -

Dehradun Institute of Technology
05-2016

Skills

Ab Initio: GDE, Metadata Hub, Control Centre, EME

Key Learnings

  • Gained Digital Credentials in Snowflake (Intermediate), Databricks (Intermediate), and Risk & Controls.
  • Built hands-on expertise in cloud-native data engineering and lakehouse architectures.
  • Attended workshops and training sessions on Apache Iceberg, AWS Immersion, and Databricks Lakehouse, strengthening knowledge of modern data platforms.

Achievements

DNA Game Changer Award: Awarded for contribution to the CFSR project for delivering defect-free code while adhering to strict timelines.

Insta Award: Awarded 4 times for multiple projects like DDR and FOM, and for delivering solutions for multiple applications simultaneously and single-handedly.

Timeline

Barclays
04.2023 - 07.2024

Senior Data Engineer

Barclays
08.2022 - Current

Barclays
08.2022 - 03.2023

Senior Data Engineer

Larsen & Toubro Infotech
04.2021 - 07.2022

Data Engineer

IBM
06.2020 - 04.2021

ETL Developer

Infosys
01.2017 - 06.2020

Bachelor of Technology -

Dehradun Institute of Technology
Lalit UpadhyayData Engineer