Hugging Face Evaluation Filter
An Introduction to AI Secure LLM Safety Leaderboard
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Community feed
evald.ai
A focused stream of recent stories from the sources curated for this community. Latest: An Introduction to AI Secure LLM Safety Leaderboard, A guide to setting up your own Hugging Face leaderboard: an end-to-end example with Vectara's hallucination leaderboard, and Bounty: Diverse hard tasks for LLM agents. Page 29.
Search
Hugging Face Evaluation Filter
A guide to setting up your own Hugging Face leaderboard: an end-to-end example with Vectara's hallucination leaderboard
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
METR Blog
Bounty: Diverse hard tasks for LLM agents
METR (formerly ARC Evals) is looking for (1) ideas, (2) detailed specifications, and (3) well-tested implementations for tasks to measure performance of autonomous LLM agents.
METR Blog
ARC Evals is now METR
ARC Evals is wrapping up our incubation period at ARC, and spinning off into our own standalone nonprofit.
Hugging Face Evaluation Filter
Open LLM Leaderboard: DROP deep dive
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
OpenAI Evaluation Filter
Frontier risk and preparedness
To support the safety of highly-capable AI systems, we are developing our approach to catastrophic risk preparedness, including building a Preparedness team and launching a challenge.
METR Blog
Responsible Scaling Policies (RSPs)
We describe the basic components of Responsible Scaling Policies (RSPs) as well as why we find them promising for reducing catastrophic risks from AI.
Hugging Face Evaluation Filter
Llama 2 on Amazon SageMaker a Benchmark
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
METR Blog
ARC Evals is spinning out from ARC
ARC Evals plans to spin out from the Alignment Research Center (ARC) in the coming months, and become its own standalone organization.
Hugging Face Evaluation Filter
Object Detection Leaderboard
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
METR Blog
New report: Evaluating Language-Model Agents on Realistic Autonomous Tasks
We have just released our first public report. It introduces methodology for assessing the capacity of LLM agents to acquire resources, create copies of themselves, and adapt to novel challenges they encounter in the wild.
Hugging Face Evaluation Filter
What's going on with the Open LLM Leaderboard?
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
More stories
More stories load automatically as you scroll.