FAR.AI logo

Loss of Control Lead (Frontier Safety)

Salary
$225K–$450K
Hiring from
Worldwide
Work type
Remote
Posted

626,187 remote jobs, straight from company career pages

100% free · New jobs every minute

Show job description

About Us

FAR.AI is a non-profit AI research institute working to ensure advanced AI is safe and beneficial for everyone. Our mission is to facilitate breakthrough AI safety research, advance global understanding of AI risks and solutions, and foster a coordinated global response.

Since our founding in July 2022, we've grown to 50+ staff, published 40+ academic papers, and convened leading AI safety events. Our work is recognized globally, with publications at premier venues such as NeurIPS, ICML including a Best Paper Honorable Mention in 2026, and ICLR, and features in the Financial Times, Nature News, Wired Magazine and MIT Technology Review. We conduct pre-deployment testing on behalf of frontier developers such as OpenAI, independent evaluations for governments including the EU AI Office, and publish the AI Security Leaderboard based on our red-teaming expertise. We help steer and grow the AI safety field through developing research roadmaps with renowned researchers such as Yoshua Bengio; running FAR.Labs, an AI safety-focused co-working space in Berkeley housing 40+ members; and supporting the community through targeted grants to technical researchers.

The Role

FAR.AI is seeking a Loss of Control Lead to create and deploy evaluations that uncover and lead to solutions for risks of autonomy and RSI. You will lead development of a testing program in this area, combining rigorous threat modeling and evaluation science, applied testing, and building an elite team to do it. Your program will work closely with frontier AI companies and leading governments, producing independent evaluation insights that greatly accelerate the world’s progress on critical safety outcomes.

As Loss of Control Lead in the FAR.AI Frontier Safety division, you will own evaluation across a risk domain, reporting to Kellin Pelrine with a dotted line to Edward Yee. You will partner closely with Kellin, the division’s technical lead, to build your testing program: you and the team you build will lead what to test and how to do it, while Frontier Safety and FAR.AI as a whole will support with frontier lab access, engineering and infrastructure, recruiting, and other systems that clear your path to impact.

There is also an individual contributor (IC) track for this role should you wish to not manage or build a team. We are open to several alternative versions of this role, including both senior IC versions that emphasize hands-on work without management duties, and manager-of-managers versions for senior leaders aiming to build multiple teams. Simply apply or reach out to talent@far.ai.

Why This Role / Why Now

FAR.AI’s Frontier Safety division exists to materially raise the bar for safety and security of the most capable AI systems in the world. We intend to be the tip of the spear in AI safety: the team that consistently finds the failures others miss, converts these into mitigations by frontier developers, and sets the standard that labs and governments converge on.

The division grew out of FAR.AI's red team, and is expanding rapidly into loss of control testing, deeper evaluations, and safeguards. From that base, we discover issues, drive their mitigation, and, where a gap in safeguards is blocking a fix, build the missing technical capacity ourselves. What we learn from building and studying safeguards then feeds back into new ways of finding vulnerabilities.

We are already one of the leading independent red-teaming organizations globally. Our work has helped most Western frontier model developers improve safeguards through pre- and post-deployment testing (e.g., OpenAI, Anthropic, and Google) and pioneered new industry standards (e.g. the FAR.AI Minimal Standard for Safeguards). We are also embedded in high-leverage government efforts (e.g., leading a consortium building CBRN evaluations for the European Commission/EU AI Office, and collaborating with the UK AI Security Institute).

Success here looks like control failures identified, safeguards strengthened, and global standards shifted – working with the leading frontier labs and informing the public, scientists, and governments globally to make this happen. We expect this role to hit the ground running, deploying testing through our established lab partners in the first month, and beginning hiring and teambuilding in the first quarter.

Key Responsibilities

Build a program of high impact loss of control testing with frontier AI companies and governments

  • Build evaluations and other testing and analysis tools that decisively uncover bad behavior and safeguard gaps in frontier AI systems

  • Develop rigorous and systematic testing methodologies and playbooks that produce credible, decision-relevant evidence about loss of control risks, including illuminating the conditions under which failures occur, evaluating the effectiveness of mitigations, and identifying important limitations in what current evaluation methods can establish

  • Strategize and execute an impact-maximizing evaluation portfolio, across a range of settings like early in model training to post deployment, and simple inference-only access to deep embedded evaluation

  • Ship private reports to key stakeholders like frontier companies and governments, informing and enabling action to improve safeguards

  • Create and support public reports, benchmarks, and leaderboards that shape industry norms

  • Fill holes in threat modeling and risk analysis, creating the end-to-end understanding and saliency needed to solve safety challenges

Manage, mentor, support, and grow an elite team

  • Plan sprints and lead execution with extremely high standards for velocity, rigor, judgment, and impact

  • Mentor team members in scientific and other skills, both in direct 1-1 settings and by building resources for rapid skill growth and knowledge transfer

  • Manage team members, supporting and amplifying their impact, setting high standards and prioritization week-to-week, and creating the environment and paths for rapid growth

  • Create processes that scale high-tempo innovation without sacrificing quality

Collaborate across FAR.AI and the field

  • Collaborate with leads in other areas to improve internal practices for rigorous, scalable, and impact-maximizing evaluation, and disseminate key findings to lift the public independent testing ecosystem

  • Contribute to the overall research and testing strategy of the Frontier Safety division

  • Partner closely with the rest of Frontier Safety to translate technical ideas and findings into real-world impact

Is This Role a Fit?

This role would be a great fit if you:

  • Are excited by high-stakes, real-world technical work where success is measured by impact, not revenue, clicks, or papers published

  • Want to work with a range of leading frontier AI companies, researchers, and governments. We’re a lean organization, and seek to leverage our impact through strategic partnerships

  • Get energy from working at the frontier of AI and shaping its path forward

  • Enjoy combining hands-on technical work with managing, mentoring, and architecting evaluations on an elite high-impact and high-performing team

  • Have deep expertise in loss of control risks or closely related areas, and are looking for the right opportunity to deploy that expertise for maximum impact

  • Have entrepreneurial drive to solve LoC risks, and possess exceptional technical judgment and a demonstrated ability to rapidly acquire domain expertise, recruit world-class experts, and integrate their work into high-impact technical programs

  • Are excited to leverage AI agents (e.g., agents for coding, testing, and analysis) at the very frontier of the field, continually building your skills and judgment to achieve superhuman results

  • Enjoy working with mission-driven colleagues to achieve real-world impact

  • Care deeply about AI safety and impacting how advanced AI systems are deployed

  • Thrive in fast-moving, ambiguous environments with shifting threat models and defenses

  • Are relentless, ready to get shit done, and willing to do whatever it takes to change the world

This role would be a poor fit if you:

  • Have neither deep domain expertise yourself in this area nor demonstrated ability to build exceptional programs relying on others to bring that expertise

  • Want to work only at the strategy level, without execution. While this program is a top priority for the division and broader organization to support, it is also a new program that must be built at high velocity to meet the challenges AI poses, and candidates will be expected to wear whatever hats come up to make it happen

  • Want to set technical direction unilaterally. You will own project execution, week-to-week sprint planning, and loss of control testing strategy, and work collaboratively with other team leads and division leadership to chart a unified path to maximizing our impact

  • Want to prioritize open-ended research, academic metrics of success like papers published, or other interests not directly connected to the Frontier Safety division’s strategy and success – our Research Lead position in the Research division may be a better fit

  • Are primarily motivated by equity upside or compensation

  • Are not willing to move at the velocity we need / want a slow-moving, highly structured environment with fixed problem definitions. As an organization, we’re planning to double in size in the next 12-18 months. We aim for the Frontier Safety division and loss of control testing to grow even faster. A lot will change, so navigating uncertainty is a core part of the role to capitalize on all the opportunities we will encounter

Must-Have Qualifications

Strong candidates for this role typically have many (but not necessarily all) of the following:

  • A strong scientific track record in AI or another highly technical subject (e.g. CS, math, physics)

  • A strong track record of building evaluations, benchmarks, datasets, or experiments testing AI capabilities or behavior, especially though not limited to AI safety

  • A strong track record of work and impact in loss of control or related risks

  • A strong track record of managing, growing, and leading technical teams

  • A strong track record of leading technical programs, developing a strategic vision and orchestrating multiple projects towards achieving it

  • Have thrived in rapidly evolving environments

  • Demonstrated drive for mission/impact and desire to create a real impact on frontier AI systems

  • Can effectively communicate technical ideas to both technical and non-technical audiences

  • Demonstrated relentlessness in achieving ambitious goals

Nice-to-Have Qualifications

  • Experience building technical products in an entrepreneurial environment

  • Demonstrated ability to discover non-obvious, high-severity risks or vulnerabilities in complex systems

  • Experience in closely related areas, e.g., alignment, cybersecurity, or red-teaming

  • Prior collaboration with AI labs or government safety institutes

  • Published work in AI safety, control, evaluation, security, or robustness

Logistics

  • Structure: If based in the USA or Singapore, you will be a full-time employee of FAR.AI (a 501(c)(3) research non-profit / non-profit CLG). Outside the USA or Singapore, you will be employed via an EOR organization on behalf of FAR.AI or as a contractor.

  • Location: Remote globally. We can sponsor US or Singapore visas. The current division is based in the US, EU, and APAC, so some timezone flexibility is expected.

  • Hours: Full-time (40 hours/week).

  • Compensation: $225,000–$450,000/year depending on experience and location, with the potential for additional compensation for exceptional candidates. We will also pay for work-related travel and equipment expenses. We offer catered lunch and dinner at our offices in Berkeley. The standard levels for this role are: $225,000–$350,000/year (default level, Loss of Control Lead (management) or Senior Research Scientist (IC)); $300,000–$450,000/year (Head of Control, for exceptional candidates with a track record of building and leading multiple technical teams in this area to execute a unified strategy).

  • Reporting: Reports to Kellin Pelrine, with a dotted line to Edward Yee.

  • Hiring process: Apply by submitting a CV and answering our questions around your interest. From there: a short screening call, work test, interviews, and finally a paid work trial. If you are not available for a work trial we may be able to find alternative ways of testing your fit.

If you're uncertain whether your background fits but are excited by the mission and challenges, we encourage you to apply – we're looking for excellence and potential, not a perfect resume match.

Benefits

  • Health Insurance: 94% of premium covered

  • 401(k): up to 2% match

  • 25 days PTO + up to 10 sick days

  • Paid Bereavement, Family, Medical, and Pregnancy Disability Leave

  • WFH Stipend & Equipment

  • Catered Meals (Berkeley Office Only)

*(Available only to full-time employees located in the US)

If you have any questions about the role, feel free to contact us at talent@far.ai. Otherwise, if you don't have questions, the best way to ensure a proper review of your skills and qualifications is by applying directly via the application form. Please don't email us to share your resume (it won't have any impact on our decision). Thank you!

Apply for this job100% free