Community feed
A focused stream of recent stories from the sources curated for this community. Latest: New funding to build towards AGI, Measuring AI Ability to Complete Long Tasks, and HCAST: Human-Calibrated Autonomy Software Tasks. Page 17.
OpenAI Evaluation Filter
Today we’re announcing new funding—$40B at a $300B post-money valuation, which enables us to push the frontiers of AI research even further, scale our compute infrastructure, and deliver increasingly powerful tools for the 500 million people who use ChatGPT...
METR Blog
We propose measuring AI performance in terms of the *length* of tasks AI agents can complete. We show that this metric has been consistently exponentially increasing over the past 6 years, with a doubling time of around 7 months. Extrapolating this trend...
METR Blog
Abstract page for arXiv paper 2503.17354: HCAST: Human-Calibrated Autonomy Software Tasks
METR Blog
Suggested priorities for the Office of Science and Technology Policy as it develops an AI Action Plan.
METR Blog
Why legible and faithful reasoning is valuable for safely developing powerful AI
METR Blog
We evaluated DeepSeek-R1 for dangerous autonomous capabilities and found no evidence of dangerous capabilities beyond those of existing models such as Claude 3.5 Sonnet and GPT-4o. Interestingly, we found that it did not do substantially better than...
METR Blog
Additional details about our evaluations of GPT-4.5, and some discussion about the limitations of pre-deployment evaluations and current evaluation methodologies.
OpenAI Evaluation Filter
This report outlines the safety work carried out prior to releasing deep research including external red teaming, frontier risk evaluations according to our Preparedness Framework, and an overview of the mitigations we built in to address key risk areas.
OpenAI Evaluation Filter
Can frontier LLMs earn $1 million from real-world freelance software engineering?
METR Blog
We measured the performance of frontier models at writing GPU kernels. With a small amount of scaffolding, we found that the best model can provide an average speedup on KernelBench of 1.8x.
Hugging Face Evaluation Filter
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Google News LLM Evaluation
LLM-as-a-judge on Amazon Bedrock Model Evaluation | Amazon Web Services Amazon Web Services (AWS)
More stories load automatically as you scroll.