English Linguistic Expert - Evaluator

Mercor is seeking experienced English Linguistic Experts to join a cutting-edge AI research project in partnership with a leading research lab. This role centers on evaluating how effectively a large language model (LLM) performs in English-language tasks and on curating high-quality English linguistic data to train and improve the model’s understanding and generation capabilities.

---

Key Responsibilities:

• Evaluate the quality and accuracy of LLM-generated English text across various use cases (e.g., summarization, dialogue, grammar correction, rewriting, and reasoning).

• Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural standards.

• Annotate English text for grammatical, syntactic, semantic, and stylistic features.

• Identify model errors, inconsistencies, and language gaps, and provide feedback to improve LLM performance.

• Provide detailed linguistic feedback and analysis to guide ongoing model training efforts.

---

You’re a strong fit if you have:

• Native or near-native fluency in English, with an excellent command of grammar, syntax, vocabulary, and stylistics.

• Professional experience in editing, proofreading, writing, linguistic annotation, language evaluation, or NLP data work in English.

• Strong understanding of linguistic nuances, regional variations, tone, and context-appropriate English usage.

• Excellent ability to identify subtle grammatical errors, awkward phrasing, ambiguity, and unnatural language.

• Interest in AI and LLM-driven language technologies is preferred but not required.

• Strong attention to detail, analytical judgment, and written communication skills.

• Ability to work independently in a distributed, remote environment.

---

Why Join

• Contribute to cutting-edge AI research in partnership with a leading research lab.

• Work on high-impact projects that directly support the development of advanced AI systems.

• Gain hands-on exposure to state-of-the-art AI research and development.

• Work fully remotely with flexible, asynchronous hours.

• Join a fast-moving project where your expertise and judgment can have a meaningful impact.