Join a cutting-edge AI research initiative and help shape the next generation of Large Language Models. We are seeking experienced Finance Specialists with deep domain expertise and hands-on experience evaluating AI model outputs using structured rubrics. In this role, you will apply your financial knowledge and professional judgment to improve AI systems by designing high-quality finance tasks, creating reference solutions, and assessing model performance against rigorous evaluation standards.
This is a fully remote, independent contractor opportunity requiring a commitment of at least 35 hours per week during weekdays.
Requirements
Key Responsibilities
Partner with research and engineering teams to improve AI models' understanding of financial reasoning, analysis, and decision-making.
Design challenging, real-world finance tasks covering a broad range of financial concepts and business scenarios.
Develop accurate, well-reasoned reference solutions based on industry best practices and professional expertise.
Evaluate AI-generated outputs using structured scoring rubrics, providing detailed written feedback on technical accuracy, reasoning quality, and financial judgment.
Create and refine evaluation frameworks, quality standards, and scoring guidelines for finance-related tasks.
Collaborate with fellow subject matter experts to ensure consistency, reliability, and high-quality training data.
Help identify knowledge gaps and recommend improvements that enhance AI performance across finance use cases.
Required Qualifications
8+ years of professional experience in finance, including one or more of the following areas:
Investment Banking
Asset Management
Corporate Finance
Financial Advisory
Experience gained at a recognized, high-performing financial institution, consulting firm, or equivalent organization.
Mandatory: Prior hands-on experience evaluating LLM/AI model outputs using structured rubrics or scoring frameworks. Applicants should clearly describe this experience in their application.
Demonstrated career progression through increasing levels of responsibility.
Ability to commit at least 35 hours per week during weekdays.
Strong analytical, problem-solving, and financial reasoning skills.
Excellent written and verbal communication abilities with exceptional attention to detail.