QA, SDET & Test Automation Engineer | Remote

QA, SDET & Test Automation Engineers. Remote AI Evaluation Project

We are seeking experienced Software Engineers, QA Engineers, SDETs, Test Automation Engineers, and Web Testing Professionals to review browser-based testing workflows for AI-generated web applications.

You will determine whether automated browser tests are technically correct, reliable, reproducible, and capable of producing clear pass or fail results.

What You’ll Do

• Review automated browser tests for AI-generated web applications
• Validate whether browser actions and test workflows are technically feasible
• Assess test setup, fixtures, isolation, execution order, and cleanup
• Confirm that assertions produce deterministic and unambiguous results
• Identify flaky tests, race conditions, timing issues, hidden dependencies, and weak validation logic
• Debug failing or unreliable browser automation workflows
• Provide structured technical feedback using project review criteria

Who Can Apply

Relevant backgrounds include:

QA Engineers, Senior QA Engineers, Quality Assurance Engineers, Software Development Engineers in Test, SDETs, Test Automation Engineers, Automation QA Engineers, Software Test Engineers, Web Test Engineers, UI Automation Engineers, End-to-End Test Engineers, E2E Test Engineers, Browser Automation Engineers, Quality Engineers, Software Quality Engineers, and Technical QA Analysts.

We also welcome:

Software Engineers, Full-Stack Engineers, Frontend Engineers, Backend Engineers, Web Developers, Application Engineers, Developer Productivity Engineers, DevOps Engineers, Release Engineers, Build Engineers, Continuous Integration Engineers, Test Infrastructure Engineers, Test Framework Engineers, Reliability Engineers, Platform Engineers, and Developer Tools Engineers with strong automated testing experience.

Additional relevant roles include:

QA Leads, Test Leads, Automation Leads, QA Architects, Test Architects, Quality Engineering Managers, Software Testing Consultants, Performance Test Engineers, Regression Test Engineers, Integration Test Engineers, API Test Engineers, Acceptance Test Engineers, Validation Engineers, and Verification Engineers.

Relevant Tools and Technologies

Experience with one or more of the following is valuable:

Playwright, Cypress, Selenium WebDriver, Puppeteer, WebdriverIO, TestCafe, Appium, Jest, Mocha, Vitest, Jasmine, Cucumber, Robot Framework, PyTest, JUnit, NUnit, TestNG, BrowserStack, Sauce Labs, LambdaTest, GitHub Actions, Jenkins, CircleCI, GitLab CI, Docker, JavaScript, TypeScript, Python, Java, C#, or similar testing technologies.

Relevant Experience

• Browser automation and modern web application testing
• Automated UI, functional, integration, regression, and end-to-end testing
• Test fixtures, mocks, test data, environment setup, and teardown
• Test isolation, reproducibility, idempotency, and deterministic execution
• Debugging flaky tests, asynchronous behavior, race conditions, and timing failures
• Validating DOM elements, navigation, forms, authentication, APIs, and application state
• Cross-browser and cross-platform testing
• Continuous integration and automated test execution
• Writing clear assertions and reliable pass or fail conditions

Requirements

• 3+ years of professional experience in software engineering, QA engineering, SDET, software testing, or test automation
• Strong experience testing modern web applications
• Hands-on experience with Playwright, Cypress, Selenium, Puppeteer, or a similar browser automation framework
• Experience writing automated UI or end-to-end tests
• Strong understanding of fixtures, test isolation, reproducibility, assertions, and reliable browser automation
• Excellent debugging, technical reasoning, and attention to detail
• Ability to provide clear and structured written feedback

Preferred Experience

• Designing or maintaining test automation frameworks
• Reviewing test code written by other engineers
• Testing AI-generated applications or dynamically generated user interfaces
• Experience with CI/CD pipelines and cloud-based testing platforms
• Experience evaluating benchmark tasks, technical rubrics, or software quality standards
• Prior experience with AI evaluation, data annotation, human feedback, or model testing projects

This opportunity is ideal for professionals who can quickly identify whether a browser test is reliable, technically valid, and suitable for use in a high-quality software benchmark. We are a referral partner of the client