Company
Mitchell Bryson AI Reliability Articles
Three announcements share a thread that should make builders take notice: AI that works when nobody's watching. Anthropic's 'dreaming' lets agents learn from their own mistakes between sessions, Claude Code Routines ship finished PRs while developers sleep,...
Mitchell Bryson AI Reliability Articles
Anthropic's accidental Mythos reveal crashed cybersecurity stocks — but the market was catching up to a reality that was already here. On the same day, CISA warned of active exploitation of AI agent frameworks, researchers disclosed basic vulnerabilities in...
METR Blog
A METR staff member spent three weeks red-teaming a subset of Anthropic's internal agent monitoring and security systems, discovering several novel vulnerabilities.
Entities: Anthropic
Mitchell Bryson AI Reliability Articles
OpenAI's 17.5% guaranteed-return PE pitch, its 450,000 sq ft campus lease, and the Helion fusion deal all point to the same shift: the AI race is no longer about who has the best model — it's about who can lock in distribution, real estate, and energy...
Topics: Benchmarks
Entities: AnthropicBenchmarksOpenAI
Hacker News LLM Evaluation
I have been reading a ton about LLM evaluation practices over the past few weeks from Anthropic’s engineering blog, Hamel Husain’s practitioner-focused guides, the Evals for AI Engineers book by Shreya Shankar and Hamel Husain, and several eval framework...
Topics: LLM Evaluation
Entities: AnthropicLLM Evaluation
METR Blog
External review from METR of Anthropic's Sabotage Risk Report for Claude Opus 4.6
Topics: Safety Evals
Entities: AnthropicSafety EvalsClaudeClaude Opus
Google News LLM Evaluation
How Anthropic’s Claude Opus 4.6 Broke Its Own AI Benchmark WinBuzzer
Topics: Benchmarks
Entities: AnthropicClaudeClaude OpusBenchmarks
Mitchell Bryson AI Reliability Articles
OpenAI shipping Codex Security, Anthropic's Claude finding 22 CVEs in Firefox in two weeks, and Microsoft treating AI agents as governed security principals all point to the same inflection: the industry is racing to close the security gap that AI coding...
Mitchell Bryson AI Reliability Articles
OpenAI amends its Pentagon deal after Altman admits it looked 'opportunistic and sloppy', while Claude surges to number one on the App Store and hundreds of employees publicly back Anthropic's stance.
Topics: Safety Evals
Entities: AnthropicSafety EvalsClaudeOpenAI
Mitchell Bryson AI Reliability Articles
Defense Secretary Pete Hegseth gives Anthropic until Friday to provide military access to Claude or face being declared a supply chain risk or forced compliance under the Defense Production Act.
Topics: Safety Evals
Entities: AnthropicSafety EvalsClaude
METR Blog
External review from METR of Anthropic's Summer 2025 Sabotage Risk Report
Topics: Safety Evals
Entities: AnthropicSafety Evals
OpenAI Evaluation Filter
OpenAI and Anthropic share findings from a first-of-its-kind joint safety evaluation, testing each other’s models for misalignment, instruction following, hallucinations, jailbreaking, and more—highlighting progress, challenges, and the value of cross-lab...
Topics: Testing Tools
Entities: AnthropicTesting ToolsOpenAI