Community feed
A focused stream of recent stories from the sources curated for this community. Latest: Bounty: Diverse hard tasks for LLM agents, ARC Evals is now METR, and Open LLM Leaderboard: DROP deep dive. Page 33.
METR Blog
METR (formerly ARC Evals) is looking for (1) ideas, (2) detailed specifications, and (3) well-tested implementations for tasks to measure performance of autonomous LLM agents.
METR Blog
ARC Evals is wrapping up our incubation period at ARC, and spinning off into our own standalone nonprofit.
Hugging Face Evaluation Filter
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
OpenAI Evaluation Filter
To support the safety of highly-capable AI systems, we are developing our approach to catastrophic risk preparedness, including building a Preparedness team and launching a challenge.
METR Blog
We describe the basic components of Responsible Scaling Policies (RSPs) as well as why we find them promising for reducing catastrophic risks from AI.
Hugging Face Evaluation Filter
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
METR Blog
ARC Evals plans to spin out from the Alignment Research Center (ARC) in the coming months, and become its own standalone organization.
Hugging Face Evaluation Filter
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
METR Blog
We have just released our first public report. It introduces methodology for assessing the capacity of LLM agents to acquire resources, create copies of themselves, and adapt to novel challenges they encounter in the wild.
Hugging Face Evaluation Filter
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
METR Blog
Input to NTIA’s AI Accountability Policy Request for Comment.
METR Blog
More information about ARC's evaluations of GPT-4 and Claude
More stories load automatically as you scroll.