KARTIK SHAH
Pune
Summary
Senior director specializing in QA engineering, possessing extensive experience in leading global QA teams, platform consolidations, and engineering transformations. Integrates executive governance with AI-driven testing utilizing LLMs, AWS Bedrock, and synthetic data, alongside end-to-end automation through Playwright CI/CD, to enhance delivery speed while maintaining system reliability.
Overview
23
23
years of professional experience
Work History
Senior Director QA Engineering
Mediaocean Asia Private Limited
Pune, Maharashtra
04.2016 - Current
- Engineered a Playwright automation framework with AWS Bedrock for adaptive end-to-end tests and data creation.
- Implemented an LLM-as-a-judge pipeline to validate test outputs and transactional states.
- Developed internal GenAI release management tools for readiness checks and deployment verification.
- Built AI-powered support ticket intelligence to categorise incidents and update sprint backlogs.
- Led integration of legacy mainframe systems with modern distributed services under unified oversight.
- Established production telemetry and checker systems to track DDR after releases.
- Standardised agile metrics comparing estimated and actual story points to mitigate bottlenecks.
- Partnered with support implementation and account management to demonstrate features and translate feedback.
- Authored multi-agent workflows leveraging Claude via AWS Bedrock to automate synthetic test data generation and test case authoring.
QA Manager
Courion Corporation
Pune, Maharashtra
05.2012 - 03.2016
- Ensured consistent quality across Courion products by establishing robust procedures and quality standards for QA organisation.
- Reviewed and updated quality assurance policies and procedures, aligning them with evolving regulations and best practices.
- Prepared detailed quality reports for senior management, highlighting performance metrics, trends, and areas for improvement.
- Facilitated training sessions for staff on quality assurance best practices and company policies.
Project Lead and Test Lead
MAQ Software
Mumbai, Maharashtra
04.2004 - 04.2012
- Managed project team, coordinating contractor activities to execute projects under-budget and within strict deadlines.
- Coordinated cross-functional teams, facilitating communication between technical and non-technical stakeholders to drive project success.
- Implemented risk management strategies to minimise project delays and cost overruns.
- Led automation and manual teams, reported to Project Manager, tracked project development life cycle, and ensured timely product delivery.
Education
B.E. - Electronics and Telecommunication
VCET
01-2003
Diploma in Industrial Electronics -
Terna Polytechnic
01-2000
Skills
- Quality assurance
- Test management
- Risk management
- Risk management strategies
- Test automation acceleration
- Automated test case generation
- Synthetic test data creation
- LLM evaluation tool development
Technical
- Programming language: C#, Java, Python
- Project Management: Jira, Confluence, Office365
- Scripting language: Groovy, JavaScript, PowerShell, Auto IT
- Version Control: GIT, Stash, SVN
- CI Tools: Jenkins, Quick Build
- Virtualisation: VMware PowerShell CLI
- Network Sniffing Tools: Fiddler, HttpWatch Basic (Tool and API), TamperIE
- Performance Tools: Performance Testing using Visual Studio, JMeter
- Automation Tools: Selenium, SoapUI, Auto IT, VSTS, UFT (QTP), Karate
- Database: Microsoft SQL Server, Oracle
- Code Coverage Tools: NCover, Visual Studio Performance Tools
- Security Testing Tools: HP Web Inspect, Burp
Timeline
Senior Director QA Engineering
Mediaocean Asia Private Limited
04.2016 - Current
QA Manager
Courion Corporation
05.2012 - 03.2016
Project Lead and Test Lead
MAQ Software
04.2004 - 04.2012
B.E. - Electronics and Telecommunication
VCET
Diploma in Industrial Electronics -
Terna Polytechnic