METR Blog
ERROR: The request could not be satisfied
Comments on NIST’s draft document “AI Risk Management Framework: Generative AI Profile.”
Community feed
evald.ai
A focused stream of recent stories from the sources curated for this community. Latest: ERROR: The request could not be satisfied, CyberSecEval 2 - A Comprehensive Evaluation Framework for Cybersecurity Risks and Capabilities of Large Language Models, and ML Engineers Needed for New AI R&D Evals Project. Page 27.
Search
Hugging Face Evaluation Filter
CyberSecEval 2 - A Comprehensive Evaluation Framework for Cybersecurity Risks and Capabilities of Large Language Models
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
METR Blog
ML Engineers Needed for New AI R&D Evals Project
METR is hiring ML engineers and researchers.
Hugging Face Evaluation Filter
Introducing the Open Arabic LLM Leaderboard
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
Introducing the Open Leaderboard for Hebrew LLMs!
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
Bringing the Artificial Analysis LLM Performance Leaderboard to Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
METR Blog
Emma Abele is METR’s new Executive Director
Emma moves from President to Executive Director, Beth moves to Head of Research.
Google News LLM Evaluation
Amazon Bedrock model evaluation is now generally available - Amazon Web Services (AWS)
Amazon Bedrock model evaluation is now generally available Amazon Web Services (AWS)
Hugging Face Evaluation Filter
Introducing the Open Chain of Thought Leaderboard
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
The Open Medical-LLM Leaderboard: Benchmarking Large Language Models in Healthcare
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
METR Blog
Autonomy Evaluation Resources
A collection of resources for evaluating potentially dangerous autonomous capabilities of frontier models.
More stories
More stories load automatically as you scroll.