Benchmarks page 14

Google News LLM Evaluation March 10, 2026 07:00

How Anthropic’s Claude Opus 4.6 Broke Its Own AI Benchmark - WinBuzzer

How Anthropic’s Claude Opus 4.6 Broke Its Own AI Benchmark WinBuzzer

Entities: Anthropic Claude Claude Opus Benchmarks

METR Blog March 10, 2026 07:00

Many SWE-bench-Passing PRs Would Not Be Merged into Main

We find that roughly half of test-passing SWE-bench Verified PRs written by recent AI agents would not be merged into main by repo maintainers. A naive interpretation of benchmark scores may lead one to overestimate how useful agents are without more...

Topics: Benchmarks

Entities: Benchmarks

Google News LLM Evaluation March 09, 2026 07:00

Researchers build Humanity’s Last Exam AI benchmark | ETIH EdTech News - EdTech Innovation Hub

Researchers build Humanity’s Last Exam AI benchmark | ETIH EdTech News EdTech Innovation Hub

Topics: Benchmarks

Entities: Benchmarks

Google News LLM Evaluation March 02, 2026 08:00

The Bullshit Index: Why the AI Benchmark You’ve Never Heard of is the One That Actually Matters - CXOToday.com

The Bullshit Index: Why the AI Benchmark You’ve Never Heard of is the One That Actually Matters CXOToday.com

Topics: Benchmarks

Entities: Benchmarks

OpenAI Evaluation Filter February 26, 2026 10:00

Pacific Northwest National Laboratory and OpenAI partner to accelerate federal permitting

OpenAI and Pacific Northwest National Laboratory introduce DraftNEPABench, a new benchmark evaluating how AI coding agents can accelerate federal permitting—showing potential to reduce NEPA drafting time by up to 15% and modernize infrastructure reviews.

Topics: Benchmarks

Entities: Benchmarks OpenAI

Google News LLM Evaluation February 25, 2026 08:00

"Humanity’s Last Exam": The Super-Benchmark AI Is Currently Failing - Neuroscience News

"Humanity’s Last Exam": The Super-Benchmark AI Is Currently Failing Neuroscience News

Topics: Benchmarks

Entities: Benchmarks

Google News LLM Evaluation February 25, 2026 08:00

NIST Publishes New Guidance to Strengthen AI Benchmark Evaluations - ExecutiveGov

NIST Publishes New Guidance to Strengthen AI Benchmark Evaluations ExecutiveGov

Topics: Benchmarks

Entities: Benchmarks

Google News LLM Evaluation February 18, 2026 19:42

OpenAI Unveils AI Benchmark Tool to Enhance Blockchain Security - thedefiant.io

OpenAI Unveils AI Benchmark Tool to Enhance Blockchain Security thedefiant.io

Topics: Benchmarks

Entities: Benchmarks OpenAI

OpenAI Evaluation Filter February 18, 2026 00:00

Introducing EVMbench

OpenAI and Paradigm introduce EVMbench, a benchmark evaluating AI agents’ ability to detect, patch, and exploit high-severity smart contract vulnerabilities.

Topics: Benchmarks

Entities: Benchmarks OpenAI

Google News LLM Evaluation February 16, 2026 08:00