Concept
METR Blog
Many AI benchmarks use algorithmic scoring to evaluate how well AI systems perform on some set of tasks. However, AI systems often produce code that scores well but isn't production-ready due to issues with test coverage, formatting, and code quality. This...
Google News LLM Evaluation
Is your AI benchmark lying to you? Nature
Hugging Face Evaluation Filter
A Blog post by Technology Innovation Institute on Hugging Face
Google News LLM Evaluation
MLPerf Client 1.0 AI benchmark released — new testing toolkit sports a GUI, covers more models and tasks, and supports more hardware acceleration paths Tom's Hardware
Google News LLM Evaluation
This new AI benchmark tests how much AI sucks up to you fanaticalfuturist.com
Google News LLM Evaluation
German Gov-Backed AI Benchmark Tracks Large Language Models in 200 Languages Slator
METR Blog
We build on our time-horizon work and analyze 9 benchmarks for scientific reasoning, math, robotics, computer use, and self-driving in terms of time-horizon trends; we observe generally similar rates of improvement to the 7-month doubling time in our...
Google News LLM Evaluation
Elon Musk’s xAI sets AI benchmark records with new reasoning-optimized Grok 4 model SiliconANGLE
Google News LLM Evaluation
Former Intel CEO’s New AI Benchmark Focuses on Human Flourishing The New Stack
Google News LLM Evaluation
Topic: Artificial intelligence (AI) benchmark and training Statista
OpenAI Evaluation Filter
HealthBench is a new evaluation benchmark for AI in healthcare which evaluates models in realistic scenarios. Built with input from 250+ physicians, it aims to provide a shared standard for model performance and safety in health.
OpenAI Evaluation Filter
BrowseComp: a benchmark for browsing agents.