We are sharing a specialised consulting opportunity for experienced QA Engineers, Software Engineers, SDETs, and Test Automation Engineers with strong expertise in browser automation and modern web application testing.
This role supports an advanced AI initiative focused on validating browser-based testing workflows for AI-generated web applications. Selected professionals will review automated tests for technical feasibility, determinism, reliability, isolation, and clear pass/fail behaviour before those workflows are incorporated into evaluation datasets.
Key Responsibilities
Browser Test Validation
Review browser-based testing workflows for modern web applications
Assess whether browser interactions are technically feasible and reliably executable
Verify that test sequences accurately represent intended user interactions
Identify workflows that may produce inconsistent or misleading results
Evaluate overall technical quality before tests are approved for use
Test Automation Review
Review automated UI and end-to-end testing implementations
Evaluate workflows built with Playwright, Cypress, Selenium, or comparable browser automation frameworks
Assess test setup, fixtures, dependencies, and execution order
Identify unnecessary coupling between tests or hidden environmental dependencies
Verify that automated tests can be reproduced consistently
Reliability & Determinism
Confirm that assertions generate clear and unambiguous pass/fail outcomes
Identify flaky tests and sources of nondeterministic behaviour
Evaluate test isolation and state management
Review timing, asynchronous behaviour, selectors, and other common sources of browser-test instability
Ensure validation logic accurately measures the intended application behaviour
Technical Review & Feedback
Debug problematic testing workflows and identify underlying technical issues
Assess whether test failures represent genuine application problems or weaknesses in the test itself
Provide structured technical feedback according to established review criteria
Document errors, ambiguities, and reliability concerns clearly
Apply consistent software-quality judgment across repeated evaluations
Ideal Profile
Strong candidates may have:
At least 3 years of professional experience in QA Engineering, Software Engineering, SDET, Test Automation, or a closely related role
Strong experience testing modern web applications
Hands-on experience with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools
Experience writing automated UI and end-to-end tests
Strong understanding of test isolation, fixtures, reproducibility, and deterministic testing
Ability to identify flaky tests, hidden dependencies, and ambiguous assertions
Excellent debugging and technical problem-solving skills
Strong attention to detail and written communication
Educational Background
A degree in computer science, software engineering, information technology, or a related technical discipline may be helpful
Equivalent professional experience in software testing or quality engineering may also be considered
Practical experience designing and maintaining production-grade automated test suites is particularly valuable
Nice to Have
Advanced experience with Playwright
Experience with Cypress or Selenium
Background designing browser automation frameworks
Experience testing complex single-page applications
Familiarity with CI/CD-based automated testing
Knowledge of test environments, fixtures, mocks, and state management
Experience reviewing or maintaining large automated testing suites
Prior experience with AI evaluation, benchmark development, or structured technical review
Why This Opportunity
Apply professional QA and test automation expertise to advanced AI evaluation
Review realistic browser-testing workflows for modern web applications
Help establish reliable quality standards for AI-generated software evaluation
Identify subtle sources of flakiness, ambiguity, and nondeterministic behaviour
Work across browser automation, test design, debugging, and software quality engineering
Participate in flexible remote consulting work with competitive hourly compensation
Contract Details
Independent contractor role
Fully remote with flexible scheduling
Competitive rates between $25–$55 per hour depending on expertise and project scope
Work may include browser-test review, automation validation, debugging, reliability assessment, and structured technical feedback
Weekly payments via Stripe or Wise
Projects may be extended, shortened, or adjusted depending on scope and performance
Work will not involve access to confidential or proprietary information from any employer, client, or institution
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy:
https://www.24-mag.com/privacy-policy
.