Kalyan Singh
Pune
Summary
Results-driven Data Engineer with expertise in AWS services and a proven track record at TIAA Global Capabilities. Spearheaded automation initiatives, enhancing data pipeline efficiency by 10x. Proficient in Python and SQL, with strong collaboration skills, delivering robust solutions in Agile environments. Recognized for optimizing complex data workflows and driving impactful analytics.
Overview
7
7
years of professional experience
1
1
Certification
Work History
Data Engineer
TIAA Global Capabilities
Pune
12.2023 - Current
- Built and managed data pipelines leveraging AWS services (S3, Glue, Airflow, Lambda, SNS, SQS, DynamoDB, CloudWatch).
- Designed and implemented Airflow DAGs for orchestrating Glue jobs, improving automation and reliability.
- Engineered complex DAG chains for seamless Snowflake to Starburst transfers via Glue Iceberg tables.
- Automated infrastructure provisioning and CI/CD workflows using Terraform, Cloudbees, and Scalr.
- Collaborated in Agile teams using Jira for planning and delivery.
Consultant & Associate Consultant
Capgemini India
Hyderabad
09.2021 - 11.2023
- Built scalable ETL pipelines using Spark and AWS technologies for consumer health analytics.
- Developed configuration-driven stored procedures for merging data streams with business-specific logic.
- Led development of a critical analytics interface, optimizing Glue-Spark jobs for 10x performance gains.
- Migrated pipelines from Cloudera to AWS, modernizing frameworks and improving robustness.
- Created reusable validation modules for 200+ interfaces; won Capgemini Best Team Award.
Senior Analyst
Capgemini India
Bangalore
07.2018 - 08.2019
- Implemented data models in Azure DataLake and SQL Data Warehouse for FMCG supply chain analytics.
- Managed Azure pipelines and Databricks workflows for critical modules.
- Collaborated with stakeholders to gather requirements and deliver robust solutions.
Education
B.Tech - Mechanical Engineering
NIT Raipur
01.2018
Skills
- Python
- SQL
- PySpark
- AWS Glue
- Airflow
- Starburst
- DynamoDB
- AWS Lambda
- AWS Step Functions
- AWS S3
- Athena
- SNS
- SQS
- CloudWatch
- Snowflake
- Azure Databricks
- Terraform
- Cloudbees
- Scalr
- PyCharm
- GitHub
- SSMS
- MS Excel
Certification
- AWS Cloud Practitioner
- Linux Command Line (Udemy)
- Capgemini Level 0 – Aspiring Architect
- Snowflake Badge 1: Data Warehousing Workshop
- Snowflake Badge 3: Sharing, Marketplace & Exchanges
Accomplishments
- XtraMile Award for performance in CH Datalake Project (2021-22)
- Best Client Value Creator & Best Team Award (2021-22)
- Rising Star Award (2018-19)
- 4th position, ISNEE QUAD-TORC 2016 (Team Captain), NIT Raipur
- 2nd position, VIGYAAN National Science Exhibition 2016, NIT Raipur
Timeline
Data Engineer
TIAA Global Capabilities
12.2023 - Current
Consultant & Associate Consultant
Capgemini India
09.2021 - 11.2023
Senior Analyst
Capgemini India
07.2018 - 08.2019
B.Tech - Mechanical Engineering
NIT Raipur
Similar Profiles
CA Uma VyavahareCA Uma Vyavahare
Associate Director at TIAA Global Capabilities Centre Pvt LtdAssociate Director at TIAA Global Capabilities Centre Pvt Ltd
Ishita GuptaIshita Gupta
ASSOCIATE, SPECIALIST - FULL STACK DEVELOPMENT at TIAA Global CapabilitiesASSOCIATE, SPECIALIST - FULL STACK DEVELOPMENT at TIAA Global Capabilities
Yashraj MohiteYashraj Mohite
Senior Associates at TIAA Global Capabilities Pvt LtdSenior Associates at TIAA Global Capabilities Pvt Ltd
Niraj DigheNiraj Dighe
Lead Software Engineer at Cloud Software GroupLead Software Engineer at Cloud Software Group
Shubham NayarShubham Nayar
Senior Associate 2 at Acko General InsuranceSenior Associate 2 at Acko General Insurance