Community feed
A focused stream of recent stories from the sources curated for this community. Latest: Details about METR's preliminary evaluation of OpenAI's o3 and o4-mini, Our updated Preparedness Framework, and BrowseComp: a benchmark for browsing agents. Page 20.
METR Blog
METR conducted a preliminary evaluation of OpenAI's o3 and o4-mini. The two models displayed higher autonomous capabilities than other public models tested, and o3 appears somewhat prone to "reward hacking".
OpenAI Evaluation Filter
Sharing our updated framework for measuring and protecting against severe harm from frontier AI capabilities.
OpenAI Evaluation Filter
BrowseComp: a benchmark for browsing agents.
Hugging Face Evaluation Filter
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
METR Blog
METR conducted a preliminary evaluation of Claude 3.7 Sonnet. While we failed to find significant evidence for a dangerous level of autonomous capabilities, the model displayed impressive AI R&D capabilities on a subset of RE-Bench which provides the...
Google DeepMind Evaluation Filter
We’re exploring the frontiers of AGI, prioritizing technical safety, proactive risk assessment, and collaboration with the AI community.
OpenAI Evaluation Filter
We introduce PaperBench, a benchmark evaluating the ability of AI agents to replicate state-of-the-art AI research.
OpenAI Evaluation Filter
Today we’re announcing new funding—$40B at a $300B post-money valuation, which enables us to push the frontiers of AI research even further, scale our compute infrastructure, and deliver increasingly powerful tools for the 500 million people who use ChatGPT...
METR Blog
We propose measuring AI performance in terms of the *length* of tasks AI agents can complete. We show that this metric has been consistently exponentially increasing over the past 6 years, with a doubling time of around 7 months. Extrapolating this trend...
METR Blog
Abstract page for arXiv paper 2503.17354: HCAST: Human-Calibrated Autonomy Software Tasks
METR Blog
Suggested priorities for the Office of Science and Technology Policy as it develops an AI Action Plan.
METR Blog
Why legible and faithful reasoning is valuable for safely developing powerful AI
More stories load automatically as you scroll.