evald.ai

Hugging Face Evaluation Filter · February 23, 2024 00:00

Introducing the Red-Teaming Resistance Leaderboard

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Topics: Benchmarks

Entities: Benchmarks

Hugging Face Evaluation Filter · February 20, 2024 00:00

Introducing the Open Ko-LLM Leaderboard: Leading the Korean LLM Evaluation Ecosystem

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Topics: BenchmarksLLM Evaluation

Entities: BenchmarksLLM Evaluation

METR Blog · February 07, 2024 08:00

2023 Year In Review

A summary of what METR accomplished in 2023 – our first full year of operation.

Hugging Face Evaluation Filter · February 02, 2024 00:00

NPHardEval Leaderboard: Unveiling the Reasoning Abilities of Large Language Models through Complexity Classes and Dynamic Updates

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Topics: Benchmarks

Entities: Benchmarks

OpenAI Evaluation Filter · January 31, 2024 08:00

Building an early warning system for LLM-aided biological threat creation

We’re developing a blueprint for evaluating the risk that a large language model (LLM) could aid someone in creating a biological threat. In an evaluation involving both biology experts and students, we found that GPT-4 provides at most a mild uplift in...

Topics: Safety Evals

Entities: Safety Evals

Hugging Face Evaluation Filter · January 31, 2024 00:00

Introducing the Enterprise Scenarios Leaderboard: a Leaderboard for Real World Use Cases

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Topics: Benchmarks

Entities: Benchmarks

Hugging Face Evaluation Filter · January 29, 2024 00:00

The Hallucinations Leaderboard, an Open Effort to Measure Hallucinations in Large Language Models

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Topics: Benchmarks

Entities: Benchmarks

Hugging Face Evaluation Filter · January 26, 2024 00:00

An Introduction to AI Secure LLM Safety Leaderboard

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Topics: Benchmarks

Entities: Benchmarks

Hugging Face Evaluation Filter · January 12, 2024 00:00

A guide to setting up your own Hugging Face leaderboard: an end-to-end example with Vectara's hallucination leaderboard

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Topics: Benchmarks

Entities: Benchmarks

METR Blog · December 16, 2023 20:00

Bounty: Diverse hard tasks for LLM agents

METR (formerly ARC Evals) is looking for (1) ideas, (2) detailed specifications, and (3) well-tested implementations for tasks to measure performance of autonomous LLM agents.

METR Blog · December 04, 2023 08:00

ARC Evals is now METR

ARC Evals is wrapping up our incubation period at ARC, and spinning off into our own standalone nonprofit.

Hugging Face Evaluation Filter · December 01, 2023 00:00

Open LLM Leaderboard: DROP deep dive

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Topics: Benchmarks

Entities: Benchmarks