Rex.zone logo
Salary
$65–$105/hr
Hiring from
Worldwide
Work type
Remote
Posted

624,466 remote jobs, straight from company career pages

100% free · New jobs every minute

Show job description

We are looking for experienced software engineers to help train and evaluate AI models on real-world programming work. You will build and validate coding tasks, review AI-generated code, and write the reference solutions and tests that models are measured against. Your engineering judgment directly shapes how reliably AI systems write, debug and refactor code.
Key Responsibilities

  • Design realistic coding tasks (bug fixes, feature implementation, refactoring, performance optimisation) with clear specifications.
  • Build reproducible environments (Git, Docker) and write automated test suites that verify solutions.
  • Write high-quality reference solutions and explain the design decisions behind them.
  • Evaluate AI-generated code for correctness, performance, security and readability.
  • Rank and compare model outputs and justify your judgments in clear written rationale.
  • Identify recurring failure patterns in model output and report them to the project team.
  • Follow project guidelines, take part in calibration and review sessions, and incorporate feedback to keep quality consistent.

Required Qualifications

  • Degree in computer science or a related field, or equivalent professional experience.
  • 3+ years of professional software engineering experience.
  • Strong Python, plus at least one of Java, C++, TypeScript, Go or Rust.
  • Proficiency with Git, Docker and automated testing.
  • Ability to read and navigate unfamiliar codebases.
  • Fluent written English and clear technical communication.
  • Reliable, detail-oriented, and able to work independently and meet deadlines in a remote setting.

Preferred Qualifications

  • Open-source contributions or code-review experience.
  • Experience with test automation, CI/CD or developer tooling.
  • Prior LLM evaluation or data annotation experience.
  • Experience with large or distributed codebases.

Legal and Compliance Notice

  • All content you submit must be lawful, and you must have the right to share it.
  • Do not submit confidential or proprietary material belonging to an employer, client or third party, or personal data without a lawful basis.
  • Rex may verify identity, credentials, ownership and licensing; may reject or remove any submission; and may report unlawful submissions to the relevant authorities.
  • Engagement and payment are subject to successful verification and to applicable sanctions, export-control, tax and employment laws.
  • The contractor agreement will set out ownership and licence terms for the work you deliver (to be confirmed by Rex Legal).

Compensation

USD $65–105 per hour, adjusted by country of residence.

Similar jobs

Apply for this job100% free