Google News Eval Frameworks
Claude Mythos Shatters AI Evaluation Ceiling, Soars Exponentially Towards 2027 Singularity - 36Kr
Claude Mythos Shatters AI Evaluation Ceiling, Soars Exponentially Towards 2027 Singularity 36Kr
Product
Claude
Google News AI Safety Evaluation
+ 1 source
Claude Mythos Shows 50% Time Horizon Of 16+ Hours On METR Benchmark - OfficeChai
Claude Mythos Shows 50% Time Horizon Of 16+ Hours On METR Benchmark OfficeChai
Mitchell Bryson AI Reliability Articles
The night shift nobody asked for - Mitchell Bryson
Three announcements share a thread that should make builders take notice: AI that works when nobody's watching. Anthropic's 'dreaming' lets agents learn from their own mistakes between sessions, Claude Code Routines ship finished PRs while developers sleep,...
Google News Eval Frameworks
Claude Opus 4.7, Gemini 3.1 Pro, and Others Score 0% on New SWE Benchmark - Analytics India Magazine
Claude Opus 4.7, Gemini 3.1 Pro, and Others Score 0% on New SWE Benchmark Analytics India Magazine
METR Blog
Review of the Anthropic Sabotage Risk Report: Claude Opus 4.6
External review from METR of Anthropic's Sabotage Risk Report for Claude Opus 4.6
Google News LLM Evaluation
How Anthropic’s Claude Opus 4.6 Broke Its Own AI Benchmark - WinBuzzer
How Anthropic’s Claude Opus 4.6 Broke Its Own AI Benchmark WinBuzzer
Mitchell Bryson AI Reliability Articles
AI finally learns to secure the code it writes - Mitchell Bryson
OpenAI shipping Codex Security, Anthropic's Claude finding 22 CVEs in Firefox in two weeks, and Microsoft treating AI agents as governed security principals all point to the same inflection: the industry is racing to close the security gap that AI coding...
Mitchell Bryson AI Reliability Articles
The Pentagon values auction: AI safety gets its market test - Mitchell Bryson
OpenAI amends its Pentagon deal after Altman admits it looked 'opportunistic and sloppy', while Claude surges to number one on the App Store and hundreds of employees publicly back Anthropic's stance.
Mitchell Bryson AI Reliability Articles
Pentagon Escalates Dispute with Anthropic, Threatens Defense Production Act - Mitchell Bryson
Defense Secretary Pete Hegseth gives Anthropic until Friday to provide military access to Claude or face being declared a supply chain risk or forced compliance under the Defense Production Act.
METR Blog
Analyzing coding agent transcripts to upper bound productivity gains from AI agents
Amy Deng investigates whether coding agent transcripts could serve as an alternative for estimating AI productivity uplift, using 5305 Claude Code transcripts from METR technical staff.
METR Blog
Measuring Time Horizon using Claude Code and Codex
Nikola Jurkovic describes our measurements of time horizon using Claude Code and Codex scaffolds.
METR Blog
Claude, GPT, and Gemini All Struggle to Evade Monitors
Vincent Cheng and Thomas Kwa replicate a Google DeepMind paper on chain-of-thought monitoring, showing evidence that monitoring works on other companies' models.