MANISH SHRIVASTAVA
Solutions Architect
Pune, Maharashtra
Summary
Accomplished Senior Data Engineer with over 14 years of experience in designing and delivering scalable data platforms in the Investment Banking and Financial Services sectors. Strong expertise in AWS cloud services, distributed data processing, and SQL analytics, complemented by recent hands-on experience in developing GenAI-powered enterprise applications using AWS Bedrock, LlamaIndex, and Athena. Recognized for effective collaboration with global stakeholders, leading complex initiatives, and delivering secure, production-grade solutions that drive business success. Results-oriented professional committed to leveraging innovative technologies to enhance data-driven decision-making.
Overview
14
14
years of professional experience
3
3
Certifications
2
2
Languages
Work History
Assistant Vice President
Barclays
07.2025 - Current
- Working in the Market Post-Trade domain, supporting internal business and operations teams with enterprise data solutions.
- Designed and built GenAI-powered Text-to-SQL applications using AWS Bedrock, LlamaIndex, and Amazon Athena, enabling natural language access to structured data.
- Architected backend services using Python and FastAPI, deployed on ECS with an Application Load Balancer for scalability and reliability.
- Implemented intelligent SQL generation, query validation, execution, result summarization, and S3-based storage for large query outputs.
- Developed agentic workflows for multi-step reasoning, error handling, and query refinement to improve response accuracy.
- Collaborating with UK stakeholders and cross-functional teams to ensure regulatory alignment, data security, and governance compliance.
- Contributing to performance optimization, cost control, and AWS best practices for production workloads.
- Tech stack: AWS Bedrock, Athena, S3, ECS, ALB, FastAPI, Python, LlamaIndex, SQL, and Git.
AWS Data Engineer
Capgemini Limited
11.2023 - 06.2025
- Worked as a Data Engineer for an investment banking client, ensuring reliable delivery of cloud-based data solutions.
- Designed and implemented scalable data pipelines using AWS Glue, S3, Athena, CloudFormation, and PySpark.
- Reduced costs by automating manual processes using AWS Lambda functions.
- Built efficient transformation frameworks using PySpark, enabling high-volume batch processing and analytics.
- Collaborated with cross-functional teams to ensure seamless integration of new data engineering solutions.
AWS PySpark Technical Lead
Saama Technologies
12.2021 - 11.2023
- Led a team of six data engineers, driving project execution and delivery excellence.
- Designed and implemented large-scale data processing pipelines using AWS Glue, S3, Apache Airflow and PySpark.
- Ensured code quality, performance optimization, and best practices across cloud-based solutions.
- Acted as a technical mentor and primary escalation point for complex data engineering challenges.
Data Engineer
SunGard (Now part of FIS)
06.2016 - 12.2021
- Led Informatica-based data integration projects for financial services clients.
- Designed and implemented complex ETL pipelines using Informatica, Oracle, Unix, PySpark and Python
- Reduced data processing time by 30% through optimized Spark jobs.
- Improved performance and memory efficiency by 25% via PySpark tuning.
Associate
Cognizant Technology Solutions
09.2014 - 06.2016
- Delivered FINREP/COREP regulatory reporting solutions for banking clients.
- Designed and developed Operational Data Stores (ODS) integrating data from multiple sources.
- Built Informatica mappings, UNIX scripts, and Oracle stored procedures to support regulatory reporting.
- Performed data profiling and quality checks using Informatica Data Quality tools.
Senior System Engineer
Infosys
08.2011 - 09.2014
- Developed and optimized ETL solutions using Informatica PowerCenter.
- Extracted data from Oracle databases and flat files with improved performance.
- Collaborated with QA and business teams to debug and resolve production issues.
Education
Bachelor of Engineering - Electronics & Communication
LNCT
Bhopal01.2011
Skills
AWS (S3, Glue, Redshift, Athena, Lambda, ECS, ALB)
Agentic AI
Generative AI
AWS Bedrock
Prompt Engineering
SQL
Apache Spark
Python
Snowflake
Gitlab CI/CD
Requirements Analysis
Data Modeling
Stakeholder communication
Problem Solving
Operations management
Certification
AWS Certified Cloud Practitioner (CLF-C01), 2023
Awards
- Shining Star, Saama Technologies, 2022
- Laureate for Project Horizon, FIS, 2018
- Innovator of the Year, Cognizant, 2015
Publications
- Automate Your Trade Journaling with AI: An n8n + Gemini Workflow
- Building AI Agents with MCP and Amazon Bedrock: From Basics to Real-World Apps
- Mastering Dimensional Data with Delta Lake: Implementing SCD2 on Databricks
- Data Skew Problem and Different Ways to Resolve it in PySpark
- Mastering Common Table Expressions (CTEs) in SQL
Timeline
Assistant Vice President
Barclays
07.2025 - Current
AWS Data Engineer
Capgemini Limited
11.2023 - 06.2025
AWS PySpark Technical Lead
Saama Technologies
12.2021 - 11.2023
Data Engineer
SunGard (Now part of FIS)
06.2016 - 12.2021
Associate
Cognizant Technology Solutions
09.2014 - 06.2016
Senior System Engineer
Infosys
08.2011 - 09.2014
Bachelor of Engineering - Electronics & Communication
LNCT