Rajat Gupta
Bangalore
Summary
With a decade of experience at Amazon and AWS, I have progressed from an intern to a senior engineer trusted to lead mission-critical initiatives across Payments, IoT, Kafka, and CloudWatch. My career reflects a consistent ability to translate complex business needs into scalable technical strategies, balancing reliability, cost efficiency, and speed of delivery. I have been recognized for building and guiding high-performing teams, fostering collaboration across global geographies, and delivering solutions that enhanced customer experience and operational excellence at scale.
Overview
10
10
years of professional experience
1
1
Certification
Work History
Senior Software Development Engineer III
AWS CloudWatch Logs & Observability
Bangalore
02.2025 - Current
- Currently part of the AWS CloudWatch Logs core team, owning query infrastructure and log data storage optimization.
- Lead a team of 10 engineers managing the SQL/PPL query engine, improving query intuitiveness and performance.
- Migrated log data to Parquet + Iceberg and introduced Arrow-based serialization, boosting query performance by 49%.
- Championed GenAI automation adoption, building frameworks that automated ~75% of repetitive engineering tasks (Ops, debugging, code fixes).
Senior Software Development Engineer III
AWS Managed Streaming for Kafka (MSK)
Seattle
06.2024 - 02.2025
- Joined the AWS MSK team, responsible for operating fully managed Kafka clusters at global scale.
- Designed and delivered Kafka Express Brokers, a cost-optimized high-throughput offering, improving efficiency of ingestion pipelines.
- Achieved $1.2M annual infra savings by optimizing service logging pipelines.
- Drove end-to-end design and team delivery of automatic partition rebalancing, eliminating manual intervention for customers; led a 12-member engineering team to implement it.
Senior Software Development Engineer III
AWS IoT Monitoring Services
Seattle
08.2022 - 05.2024
- Part of the AWS IoT Monitoring Services team, focused on real-time anomaly detection and predictive maintenance for industrial IoT.
- Served as tech lead for a 10-member team, delivering near real-time anomaly detection software saving customers millions annually.
- Built an in-house time-series database and pre-compute pipeline, enabling high-performance ML-based anomaly inference.
- Designed and deployed ML workflows for continuous model training, retraining, and inference on live IoT data.
Software Development Engineer II
AWS IoT Analytics Team
Seattle
12.2019 - 07.2022
- Joined the AWS IoT Analytics team, enabling large-scale IoT data processing and analytics for industrial and enterprise customers.
- Designed a real-time IoT alarming engine to process millions of device events with exactly-once guarantees using Apache Kafka and Flink.
- Delivered a highly available, low-latency IoT monitoring pipeline, ensuring data freshness and fault tolerance for mission-critical workloads.
Software Development Engineer II
Amazon Pay – UPI Team
Hyderabad
07.2018 - 11.2019
- Joined the Amazon Pay UPI team, building India’s UPI payments offering from the ground up.
- Played dual role as full-stack engineer, developing user interfaces and the transactional backend service for millions of UPI payments.
- Delivered the RBI-mandated compliance migration project (EU → India data hosting) under strict deadlines, ensuring uninterrupted payment flows.
- Strengthened expertise in building at scale under regulatory constraints and tight delivery schedules.
Software Development Engineer I
Amazon Payments – Wallet & Gift Cards Team
Hyderabad
08.2016 - 07.2018
- Built a payment reconciliation system ensuring correctness and high availability across millions of global credit/debit card transactions.
- Developed a secure SFTP-based ledger service to transmit payment data to banks, ensuring compliance with global financial standards.
- Strengthened skills in architectural trade-offs, fault tolerance, and large-scale distributed systems.
Software Developer Intern
Amazon
Hyderabad
02.2016 - 07.2016
- Designed and implemented delivery options service, enabling customers to select delivery promises at checkout.
- Built and integrated REST APIs for real-time visibility of delivery choices in order workflow.
Education
Bachelor of Science - Computer Science
Jaypee Institute of Technology And Information
Noida, India07-2016
Skills
- Software Engineering & Architecture: Java, Python, SQL optimization, concurrency management, scalable microservices, distributed systems, API development
- Cloud & Infrastructure: AWS architecture (CloudWatch, MSK, IoT, S3, DynamoDB), cloud-native design, infrastructure as code, containerization (Docker/Kubernetes), load balancing, auto scaling, monitoring & logging
- Data & Analytics: Kafka administration, real-time data pipelines, anomaly detection, big data analytics, systems design for high-throughput workloads
- Machine Learning & Automation: Model training/retraining, real-time inference, ML-driven anomaly detection, GenAI automation frameworks
- Leadership & Delivery: Technical leadership, project management, agile methodologies, team collaboration, strategic planning, effective communication, problem solving
Certification
- Certified AWS Solutions Architect
- Certified AWS Developer Associate
Languages
Hindi
First Language
English
Advanced (C1)
C1
Timeline
Senior Software Development Engineer III
AWS CloudWatch Logs & Observability
02.2025 - Current
Senior Software Development Engineer III
AWS Managed Streaming for Kafka (MSK)
06.2024 - 02.2025
Senior Software Development Engineer III
AWS IoT Monitoring Services
08.2022 - 05.2024
Software Development Engineer II
AWS IoT Analytics Team
12.2019 - 07.2022
Software Development Engineer II
Amazon Pay – UPI Team
07.2018 - 11.2019
Software Development Engineer I
Amazon Payments – Wallet & Gift Cards Team
08.2016 - 07.2018
Software Developer Intern
Amazon
02.2016 - 07.2016
Bachelor of Science - Computer Science
Jaypee Institute of Technology And Information
Similar Profiles
BHANU PRAKASH KOVURIBHANU PRAKASH KOVURI
Director of Engineering at Splunk ObservabilityDirector of Engineering at Splunk Observability
ALLAN MANNALLAN MANN
Technical Author at Mastering ObservabilityTechnical Author at Mastering Observability
Muhammad Yoga PratomoMuhammad Yoga Pratomo
IT Support at GOMERCHANTS Observability TeamIT Support at GOMERCHANTS Observability Team
Muskan JainMuskan Jain
Associate – Bid Management at Subex Ltd.Associate – Bid Management at Subex Ltd.
Lakshmi Durga KogantiLakshmi Durga Koganti
Technical Writer at Cisco Systems Inc. Ltd.Technical Writer at Cisco Systems Inc. Ltd.