Role Summary
The Test Lead is responsible for defining the test strategy and leading automation execution for AI-enabled applications. The role provides technical leadership and ensures consistent quality across UI, API, and data layers.
Key Responsibilities
Define an automation-first, end-to-end test strategy covering AI agents, orchestration layers, backend APIs, and UI applications.
Lead and govern Selenium and/or Playwright-based automation frameworks across multi-agent workflows, APIs, and portals.
Provide technical guidance and conduct code reviews for Java- and Python-based automation implementations.
Oversee testing across AI agents and services supporting end-to-end automated and analytical workflows.
Review and guide AI testing coverage, including prompt testing, guardrail validation, response accuracy, and reasoning checks.
Ensure adequate test coverage for the System Under Test (SUT).
Lead regression planning, defect triage, root cause analysis (RCA), reporting, and release sign-offs.
Mentor test engineers and ensure consistent QA standards, best practices, and automation quality.
Required Skills (Must Have)
Strong automation development experience
Proficiency in Java or Python
Expertise in Selenium and/or Playwright frameworks
Experience in API automation and SQL-based data validation
Hands-on knowledge of at least one AI testing tool (e.g., Testsigma, Testim, Mabl, or Functionize)
Understanding of cloud-based platforms (e.g., Microsoft Azure)
Minimum of 2 years of hands-on experience testing GenAI and Agentic AI solutions across production, client-facing, or enterprise systems, including involvement in test coordination and review activities
Good to Have
ERP / Accounts Payable knowledge (e.g., Oracle ERP, SAP)
ISTQB certification