Company
Google News LLM Evaluation
‘Baffling’: White House won’t publicly release AI model evaluation framework it reviewed today with OpenAI, Anthropic, Microsoft, and others Fortune
Mitchell Bryson AI Reliability Articles
Anthropic saying its own AI models breached three companies, TechCrunch’s analysis of the Hugging Face breach, Google saying AI fixed more Chrome bugs in June than over the past two years, and Okta buying Permiso for about $200M all point to the same shift:...
METR Blog
Anthropic reported that contributors merge 8x as much code per day as before AI. Thomas Kwa argues that under standard economic modeling assumptions, this implies the uplift of individual Anthropic researchers from coding agents alone is above 2x.
Mitchell Bryson AI Reliability Articles
Three stories from the past 24 hours point to the same uncomfortable truth: AI can now find software vulnerabilities far faster than humans can patch them, and the gap is widening on both sides of the line. Anthropic's Project Glasswing update reports over...
Mitchell Bryson AI Reliability Articles
Analysis of Google's interception of an AI-generated zero-day exploit and what divergent responses from OpenAI, Anthropic, and Microsoft mean for builders.
METR Blog
External review from METR of the "Risks from automated R&D" section in Anthropic's February 2026 Risk Report
Mitchell Bryson AI Reliability Articles
Three announcements share a thread that should make builders take notice: AI that works when nobody's watching. Anthropic's 'dreaming' lets agents learn from their own mistakes between sessions, Claude Code Routines ship finished PRs while developers sleep,...
Mitchell Bryson AI Reliability Articles
Anthropic's accidental Mythos reveal crashed cybersecurity stocks — but the market was catching up to a reality that was already here. On the same day, CISA warned of active exploitation of AI agent frameworks, researchers disclosed basic vulnerabilities in...
METR Blog
A METR staff member spent three weeks red-teaming a subset of Anthropic's internal agent monitoring and security systems, discovering several novel vulnerabilities.
Mitchell Bryson AI Reliability Articles
OpenAI's 17.5% guaranteed-return PE pitch, its 450,000 sq ft campus lease, and the Helion fusion deal all point to the same shift: the AI race is no longer about who has the best model — it's about who can lock in distribution, real estate, and energy...
Hacker News LLM Evaluation
I have been reading a ton about LLM evaluation practices over the past few weeks from Anthropic’s engineering blog, Hamel Husain’s practitioner-focused guides, the Evals for AI Engineers book by Shreya Shankar and Hamel Husain, and several eval framework...
METR Blog
External review from METR of Anthropic's Sabotage Risk Report for Claude Opus 4.6