METR Blog
ML Engineers Needed for New AI R&D Evals Project
METR is hiring ML engineers and researchers.
Community feed
evald.ai
A focused stream of recent stories from the sources curated for this community. Latest: ML Engineers Needed for New AI R&D Evals Project, Introducing the Open Arabic LLM Leaderboard, and Introducing the Open Leaderboard for Hebrew LLMs!. Page 25.
Search
Hugging Face Evaluation Filter
Introducing the Open Arabic LLM Leaderboard
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
Introducing the Open Leaderboard for Hebrew LLMs!
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
Bringing the Artificial Analysis LLM Performance Leaderboard to Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
METR Blog
Emma Abele is METR’s new Executive Director
Emma moves from President to Executive Director, Beth moves to Head of Research.
Google News LLM Evaluation
Amazon Bedrock model evaluation is now generally available - Amazon Web Services (AWS)
Amazon Bedrock model evaluation is now generally available Amazon Web Services (AWS)
Hugging Face Evaluation Filter
Introducing the Open Chain of Thought Leaderboard
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
The Open Medical-LLM Leaderboard: Benchmarking Large Language Models in Healthcare
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
METR Blog
Autonomy Evaluation Resources
A collection of resources for evaluating potentially dangerous autonomous capabilities of frontier models.
METR Blog
Example autonomy evaluation protocol
An example protocol for the whole evaluation process, based on our task suite, elicitation protocol, and scoring methods.
METR Blog
GitHub - METR/public-tasks
Contribute to METR/public-tasks development by creating an account on GitHub.
More stories
More stories load automatically as you scroll.