PulseAugur
LIVE 13:04:48
research · [3 sources] ·
0
research

ARC Evals is now METR

By PulseAugur Editorial · Summary by None from 3 sources

The Alignment Research Center's (ARC) evaluation team has officially spun off to form a new independent nonprofit organization named METR (Model Evaluation & Threat Research). METR will continue its work on evaluating frontier AI systems, focusing on their autonomous capabilities and potential threats, including AI self-improvement and evasion of oversight. The organization, led by Beth Barnes, has previously partnered with leading AI labs like OpenAI and Anthropic for evaluations and aims to develop rigorous testing methodologies to ensure AI safety before widespread deployment. AI

Summary written by None from 3 sources. How we write summaries →

RANK_REASON Spin-off of an AI evaluation team into a new research organization.

Read on METR (Model Evaluation & Threat Research) →

COVERAGE [3]

  1. METR (Model Evaluation & Threat Research) TIER_1 ·

    ARC Evals is now METR

    <p><em>Model Evaluation &amp; Threat Research, pronounced ‘meter’</em></p> <p>As we <a href="https://evals.alignment.org/blog/2023-09-19-spin-out-announcement/">announced two months ago</a>, ARC Evals is wrapping up our incubation period at ARC (the <a href="https://www.alignment…

  2. METR (Model Evaluation & Threat Research) TIER_1 ·

    ARC Evals is spinning out from ARC

    <p>ARC was founded as a small alignment theory organization run by Paul Christiano. In 2022 it hired Beth Barnes and incubated ARC Evals to do exploratory work on independent evaluations of cutting-edge AI models; Paul remained focused on <a href="https://www.alignment.org/theory…

  3. METR (Model Evaluation & Threat Research) TIER_1 ·

    Update on ARC's recent eval efforts

    <p>We believe that capable enough AI systems could pose very large risks to the world. We do not think today’s systems are capable enough to pose these sorts of risks, but we think that this situation could change quickly and it’s important to be monitoring the risks consistently…

RELATED TOPICS