Hugging Face Evaluation Filter
The Open Arabic LLM Leaderboard 2
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Topics: Benchmarks
Entities: Benchmarks
Topic feed
Benchmarks
AI benchmarks, leaderboards, and comparative model testing.
Hugging Face Evaluation Filter
DABStep: Data Agent Benchmark for Multi-step Reasoning
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Topics: Benchmarks
Entities: Benchmarks
Hugging Face Evaluation Filter
CO₂ Emissions and Models Performance: Insights from the Open LLM Leaderboard
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Topics: Benchmarks
Entities: Benchmarks
Google News LLM Evaluation
What Makes a Good AI Benchmark? - Stanford HAI
What Makes a Good AI Benchmark? Stanford HAI
Topics: Benchmarks
Entities: Benchmarks
Hugging Face Evaluation Filter
Rethinking LLM Evaluation with 3C3H: AraGen Benchmark and Leaderboard
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Topics: BenchmarksLLM Evaluation
Entities: BenchmarksLLM Evaluation
METR Blog
Evaluating frontier AI R&D capabilities of language model agents against human experts
We’re releasing RE-Bench, a new benchmark for measuring the performance of humans and frontier model agents on ML research engineering tasks. We also share data from 71 human expert attempts and results for Anthropic’s Claude 3.5 Sonnet and OpenAI’s...
Topics: Benchmarks
Entities: AnthropicClaudeBenchmarksOpenAI
Hugging Face Evaluation Filter
Introducing the Open Leaderboard for Japanese LLMs!
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Topics: Benchmarks
Entities: Benchmarks
OpenAI Evaluation Filter
Introducing SimpleQA
A factuality benchmark called SimpleQA that measures the ability for language models to answer short, fact-seeking questions.
Topics: Benchmarks
Entities: Benchmarks
OpenAI Evaluation Filter
MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
We introduce MLE-bench, a benchmark for measuring how well AI agents perform at machine learning engineering.
Topics: Benchmarks
Entities: Benchmarks
Hugging Face Evaluation Filter
Introducing the Open FinLLM Leaderboard
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Topics: Benchmarks
Entities: Benchmarks
Hugging Face Evaluation Filter
Our Transformers Code Agent beats the GAIA benchmark 🏅
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Topics: Benchmarks
Entities: Benchmarks
Hugging Face Evaluation Filter
Launching the Artificial Analysis Text to Image Leaderboard & Arena
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Topics: Benchmarks
Entities: Benchmarks