Oliver Bernard logo

AI Engineer

Oliver Bernard
Posted 5 hours ago
United KingdomRemote£75K–£85KEngineering & Development
Is this job info correct?

AI Engineer - Remote (UK) - Early Stage EdTech - £75-85k + equity


Remote within the UK, with occasional in-person meetups in London


I'm working with an early-stage, VC-backed startup building an AI-powered assessment platform, to find an AI Engineer to join their small, fully remote team.


About the Role


You'll build and improve the systems powering AI-assisted marking, feedback and assessment. This means delivering assessment workflows for customers end-to-end — from requirements through implementation, evaluation, production release and ongoing improvement — while also contributing to a shared assessment engine that turns recurring patterns into reusable, configurable capabilities.


This is a hands-on role: production Python, large language models, and other AI systems. You'll investigate failures, evaluate non-deterministic workflows, and make practical trade-offs between quality, latency and cost.


What You'll Do

  • Deliver AI-assisted assessment workflows from requirements through production and ongoing improvement
  • Translate marking guidance into rubrics, schemas, prompts and LLM programs
  • Build and maintain production Python code for assessment workflows and shared AI components
  • Design evaluation methods using representative datasets, regression tests, and statistical analysis
  • Investigate failed or contested assessments and improve workflows accordingly
  • Build human-review and feedback-driven optimisation workflows
  • Extend multimodal assessment capabilities across documents, images and video


Core Requirements

  • Experience building and improving LLM- or ML-based systems in production
  • Strong Python engineering skills in production codebases
  • Experience designing evaluations or regression tests for non-deterministic systems, with real statistical grounding
  • Ability to investigate failures systematically and make sound engineering trade-offs
  • At least 3 years of relevant AI/ML engineering experience, or a relevant postgraduate degree plus applied experience


Nice to Have

  • Experience with prompt/program optimisation frameworks (DSPy, GEPA, AdalFlow) or continuous evaluation workflows
  • Experience with multimodal or document-processing systems
  • Experience with LLM tracing/eval tools (Langfuse, MLflow, W&B, LangSmith)
  • Experience with assessment technology or EdTech
  • Cloud deployment experience (AWS, Azure, GCP)


You must be based in the UK and have the full right to work without sponsorship to be considered.


AI Engineer - Remote (UK) - Early Stage EdTech - £75-85k + equity

Similar jobs