Summary
Overview
Work History
Education
Skills
Websites
Certification
Accomplishments
Timeline
Generic

Kalyan Singh

Pune

Summary

Results-driven Data Engineer with expertise in AWS services and a proven track record at TIAA Global Capabilities. Spearheaded automation initiatives, enhancing data pipeline efficiency by 10x. Proficient in Python and SQL, with strong collaboration skills, delivering robust solutions in Agile environments. Recognized for optimizing complex data workflows and driving impactful analytics.

Overview

7
7
years of professional experience
1
1
Certification

Work History

Data Engineer

TIAA Global Capabilities
Pune
12.2023 - Current
  • Built and managed data pipelines leveraging AWS services (S3, Glue, Airflow, Lambda, SNS, SQS, DynamoDB, CloudWatch).
  • Designed and implemented Airflow DAGs for orchestrating Glue jobs, improving automation and reliability.
  • Engineered complex DAG chains for seamless Snowflake to Starburst transfers via Glue Iceberg tables.
  • Automated infrastructure provisioning and CI/CD workflows using Terraform, Cloudbees, and Scalr.
  • Collaborated in Agile teams using Jira for planning and delivery.

Consultant & Associate Consultant

Capgemini India
Hyderabad
09.2021 - 11.2023
  • Built scalable ETL pipelines using Spark and AWS technologies for consumer health analytics.
  • Developed configuration-driven stored procedures for merging data streams with business-specific logic.
  • Led development of a critical analytics interface, optimizing Glue-Spark jobs for 10x performance gains.
  • Migrated pipelines from Cloudera to AWS, modernizing frameworks and improving robustness.
  • Created reusable validation modules for 200+ interfaces; won Capgemini Best Team Award.

Senior Analyst

Capgemini India
Bangalore
07.2018 - 08.2019
  • Implemented data models in Azure DataLake and SQL Data Warehouse for FMCG supply chain analytics.
  • Managed Azure pipelines and Databricks workflows for critical modules.
  • Collaborated with stakeholders to gather requirements and deliver robust solutions.

Education

B.Tech - Mechanical Engineering

NIT Raipur
01.2018

Skills

  • Python
  • SQL
  • PySpark
  • AWS Glue
  • Airflow
  • Starburst
  • DynamoDB
  • AWS Lambda
  • AWS Step Functions
  • AWS S3
  • Athena
  • SNS
  • SQS
  • CloudWatch
  • Snowflake
  • Azure Databricks
  • Terraform
  • Cloudbees
  • Scalr
  • PyCharm
  • GitHub
  • SSMS
  • MS Excel

Certification

  • AWS Cloud Practitioner
  • Linux Command Line (Udemy)
  • Capgemini Level 0 – Aspiring Architect
  • Snowflake Badge 1: Data Warehousing Workshop
  • Snowflake Badge 3: Sharing, Marketplace & Exchanges

Accomplishments

  • XtraMile Award for performance in CH Datalake Project (2021-22)
  • Best Client Value Creator & Best Team Award (2021-22)
  • Rising Star Award (2018-19)
  • 4th position, ISNEE QUAD-TORC 2016 (Team Captain), NIT Raipur
  • 2nd position, VIGYAAN National Science Exhibition 2016, NIT Raipur

Timeline

Data Engineer

TIAA Global Capabilities
12.2023 - Current

Consultant & Associate Consultant

Capgemini India
09.2021 - 11.2023

Senior Analyst

Capgemini India
07.2018 - 08.2019

B.Tech - Mechanical Engineering

NIT Raipur
Kalyan Singh