Srishti Agarwal
Senior SDET
New Delhi
Summary
Lead Automation Test Engineer with 9 years of experience in UI, API, Mobile, and GenAI testing.
Experienced in Python, Playwright, Selenium, PyTest, AI V oice Agents, RAG, DeepEval, and LangFuse.
Skilled in building automation frameworks and delivering scalable, high-quality software solutions.
Overview
9
9
years of professional experience
Work History
Lead SDET
Intellify AI
Remote
01.2026 - Current
- Led end-to-end QA and automation for an AI-powered multilingual V oice Agent platform built on
LiveKit and Twilio. - Developed Playwright (Python) UI automation for Login, Agent Management, Knowledge Base,
Conversation, and Analytics modules. - Built PyTest API automation for RBAC, Tenant Management, Agent Management, and backend
microservices. - Automated AI response validation using DeepEval (LLM-as-a-Judge) and RAG testing for response
accuracy, grounding, and faithfulness. - Performed API, UI, integration, regression, and end-to-end testing for a multi-tenant RBAC-based
platform. - Worked closely with developers and AI engineers to improve AI response quality and automate
regression suites.
Senior QA Automation
Dario
05.2025 - 12.2025
- Developed Android and iOS mobile automation using Java, Appium, XCUITest, and Appium
Inspector. - Built a Python automation framework to validate AI input/output guardrails using prompt datasets.
- Automated AI response evaluation using DeepEval (LLM-as-a-Judge) for accuracy, adherence, and
compliance. - Integrated LangFuse for AI evaluation reporting, including scores, pass/fail status, and reasoning.
- Served as Scrum Master for the Automation team, facilitating Agile ceremonies and sprint execution.
- Utilized Cursor AI and MCP servers to enhance mobile test automation and improve productivity.
Senior SDET
STEM
Gurgaon
11.2022 - Current
- Collaborated with stakeholders to gather testing requirements and design comprehensive test plans.
- Developed and maintained integration tests in Python for both API and UI validations, ensuring robust end-to-end coverage.
- Monitored application and infrastructure logs via Kubernetes Pods and Kibana to proactively identify and troubleshoot issues.
- Refactored existing test scenarios to improve code coverage and significantly reduce execution time.
- Gained in-depth understanding of multiple microservices, reviewed codebase, and identified potential vulnerabilities across services.
- Understood internal structure of Kubernetes environments to support testing, and debugging across distributed systems.
Senior SDET
BirdEye
Gurgaon
11.2019 - 11.2022
- Designing automation framework for API Testing and custom reporting. Complete ownership of multiple modules API Automation.
- Perform manual and automation testing of complex projects including multiple microservices.
- Making automation suite flexible to execute tests on multiple environments.
- Writing automation scripts for verifying APIs using Rest assured. Enhancement and fixes for report and test cases.
- End to End manual testing of module including requirement analysis, bug tracking, environment setup, logs monitoring and production release ensuring product stability.
- Creating multiple parameterized Jenkins job and maintaining it.
Software Engineer II- Test Automation
QA InfoTech
Noida
06.2017 - 11.2019
- Project 1 Store Finance): Kafka and database testing for application to manage price mark-ups and mark-downs.
Tool Used: Database and Kafka testing using Cucumber framework and Kafka Code. - Project 2Digitization of Verifying OMR Sheets): Verify OMR sheets APIs manually using postman and automation of APIs.
Tool Used: Cucumber Test Framework and Rest Assured API Testing. - Project 3Political Journalism):A web application testing by designing, documenting and automating the test cases.
Tool Used: Selenium and Test NG Framework.
Education
B.Tech - Computer Science
ABES Engineering College
Ghaziabad, India 08.2013 - 04.2017
Intermediate -
CMS
Lucknow 04.2001 -
Secondary -
S.t. Norberst's School
Bahraich 04.2001 -
Skills
Lanuages: Python, Core Java
DB: MySQL
Tools: Applitools, Eclipse, PyCharm, Postman, jenkins, Kibana, Kafka, Elastic Search, Kubernetes, AWS, Jupyter Notebook
Frameworks: Playwright, Selenium, TestNG, rest assured, Cucumber, Appium
Gen AI Testing: DeepEval, LangFuse, RAG, AI Guardrails, Knowledge Base Testing
CI/CD & Monitoring: Jenkins, Kubernetes, Kibana, Kafka, Elastic Search, Github Actions
Timeline
Lead SDET
Intellify AI
01.2026 - Current
Senior QA Automation
Dario
05.2025 - 12.2025
Senior SDET
STEM
11.2022 - Current
Senior SDET
BirdEye
11.2019 - 11.2022
Software Engineer II- Test Automation
QA InfoTech
06.2017 - 11.2019
B.Tech - Computer Science
ABES Engineering College
08.2013 - 04.2017
Intermediate -
CMS
04.2001 -
Secondary -
S.t. Norberst's School
04.2001 -