Hugging Face Evaluation Filter
Rethinking LLM Evaluation with 3C3H: AraGen Benchmark and Leaderboard
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Topic feed
Benchmarks
AI benchmarks, leaderboards, and comparative model testing.
METR Blog
Evaluating frontier AI R&D capabilities of language model agents against human experts
We’re releasing RE-Bench, a new benchmark for measuring the performance of humans and frontier model agents on ML research engineering tasks. We also share data from 71 human expert attempts and results for Anthropic’s Claude 3.5 Sonnet and OpenAI’s...
Hugging Face Evaluation Filter
Introducing the Open Leaderboard for Japanese LLMs!
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
OpenAI Evaluation Filter
Introducing SimpleQA
A factuality benchmark called SimpleQA that measures the ability for language models to answer short, fact-seeking questions.
OpenAI Evaluation Filter
MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
We introduce MLE-bench, a benchmark for measuring how well AI agents perform at machine learning engineering.
Hugging Face Evaluation Filter
Introducing the Open FinLLM Leaderboard
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
Our Transformers Code Agent beats the GAIA benchmark 🏅
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
Launching the Artificial Analysis Text to Image Leaderboard & Arena
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
Introducing the Open Arabic LLM Leaderboard
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
Introducing the Open Leaderboard for Hebrew LLMs!
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
Bringing the Artificial Analysis LLM Performance Leaderboard to Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
Introducing the Open Chain of Thought Leaderboard
We’re on a journey to advance and democratize artificial intelligence through open source and open science.