ARC Evals is now METR
ARC Evals is wrapping up our incubation period at ARC, and spinning off into our own standalone nonprofit.
Source feed
116 items
METR is a research nonprofit that evaluates frontier AI models to inform the public about their risks and capabilities.
ARC Evals is wrapping up our incubation period at ARC, and spinning off into our own standalone nonprofit.
Describimos los componentes básicos de las políticas de escalamiento responsable (RSP) y por qué creemos que pueden ayudar a reducir los riesgos catastróficos de la IA.
本文介绍负责任扩展政策(RSP)的基本内容,以及为什么我们认为 RSP 有望降低 AI 带来的灾难性风险。
We describe the basic components of Responsible Scaling Policies (RSPs) as well as why we find them promising for reducing catastrophic risks from AI.
ARC Evals plans to spin out from the Alignment Research Center (ARC) in the coming months, and become its own standalone organization.
We have just released our first public report. It introduces methodology for assessing the capacity of LLM agents to acquire resources, create copies of themselves, and adapt to novel challenges they encounter in the wild.
Input to NTIA’s AI Accountability Policy Request for Comment.
More information about ARC's evaluations of GPT-4 and Claude
Topics: LLM Evaluation
Entities: ClaudeLLM Evaluation