QA Engineer, Agentic Development

Overview

Clariti is building a new product with a team that uses agentic development to move quickly. As a QA Engineer, you will help define how quality works across that process. You will shape the testing strategy, own the automation that backs it, and decide where testing effort will do the most good. You will work closely with developers, product, and AI-assisted tooling to keep quality high without slowing delivery.

Responsibilities

• Shape quality from the start of each feature: work with product and engineering on acceptance criteria, testability, and definition of done before code is written.
• Design and own the automated QA workflow for agentic delivery, from triage through test generation and execution reporting, and keep it reliable as volume grows.
• Review AI-generated tests and code for correctness, gaps, and false confidence.
• Probe beyond the written criteria, including edge cases, failure paths, data integrity, security, performance, and cross-system behavior, and feed what you find back into stories and the pipeline.
• Keep coverage deliberate and efficient: map risk to tests, and prune generated or duplicate tests that add maintenance cost without adding confidence.
• Design and maintain end-to-end and API automation with Playwright and TypeScript.
• Build and maintain CI/CD quality gates so every change is verified before merge without becoming a bottleneck.
• Track quality and efficiency metrics, such as escape rate, flake rate, acceptance-criteria coverage, suite runtime, and maintenance effort.
• Triage failures across automated and human-written tests, find root causes, and fix the system so the same failure class doesn't recur.
• Make technical quality decisions on architecture, test data, and environments.
• Upskill the team on testing for agentic development, including how to specify work so that generated tests are useful.

What You Bring

• 5+ years of experience in QA, SDET, or software engineering with a quality focus.
• 3-5 years of hands-on Playwright automation with TypeScript or JavaScript.
• Experience establishing or significantly shaping QA practices on a product, whether at a startup, scale-up, or new product team, and whether or not you were there from day one.
• Experience using AI coding assistants and agentic tools in a real delivery workflow, with a clear view of where they are reliable and where human judgment is needed.
• A quality-ownership mindset: you see quality across the whole system, raise concerns about unclear requirements early, and identify what needs testing without being told.
• Exploratory and risk-based testing instincts: you find behavior nobody specified and judge which risks are worth the effort.
• Ability to read and critically evaluate code, including code you did not write.
• Experience building or maintaining CI/CD test pipelines.
• Solid grounding in Agile and test strategy, including risk-based planning, the test pyramid, and regression scope.

Bonus Points

• Familiarity with one or more structured agentic development methodologies, and curiosity about how different teams practice them.
• Experience designing evals or quality metrics for LLM- or agent-based systems.
• Experience reducing test suite bloat or flakiness in a large automation codebase.
• Experience with API testing tools (Postman, RestAssured) and contract testing.
• Experience with Jira automation or test case management systems.

We invest in and empower our team members with competitive compensation packages, well deserved time off and benefits to keep you and your family healthy! *

💰 The base salary range for this role is expected to be between $75,000-$90,000 based on the candidate’s skills, experience, and qualifications while considering internal pay equity and our broader pay philosophy. 💰

If you have questions about compensation as we move through the process, we’re happy to discuss further.

*Benefits depend on employment type (full-time, part-time, contract, etc).