evald.ai

OpenAI Evaluation Filter · November 12, 2025 00:00

GPT-5.1 Instant and GPT-5.1 Thinking System Card Addendum

This GPT-5 system card addendum provides updated safety metrics for GPT-5.1 Instant and Thinking, including new evaluations for mental health and emotional reliance.

OpenAI Evaluation Filter · November 03, 2025 22:30

Introducing IndQA

OpenAI introduces IndQA, a new benchmark for evaluating AI systems in Indian languages. Built with domain experts, IndQA tests cultural understanding and reasoning across 12 languages and 10 knowledge areas.

Topics: Benchmarks

Entities: BenchmarksOpenAI

Mitchell Bryson AI Reliability Articles · November 02, 2025 00:00

Human Gates, Agent Throughput: An autonomy ladder that scales without losing control - Mitchell Bryson

A practical model for growing AI agent autonomy - levels, controls, and KPIs - grounded in risk frameworks (NIST AI RMF, ISO/IEC 42001) and aligned with EU AI Act oversight.

Topics: Safety Evals

Entities: Safety Evals

OpenAI Evaluation Filter · October 29, 2025 00:00

gpt-oss-safeguard technical report

gpt-oss-safeguard-120b and gpt-oss-safeguard-20b are two open-weight reasoning models post-trained from the gpt-oss models and trained to reason from a provided policy in order to label content under that policy. In this report, we describe...

METR Blog · October 28, 2025 09:47

Review of the Anthropic Summer 2025 Pilot Sabotage Risk Report

External review from METR of Anthropic's Summer 2025 Sabotage Risk Report

Topics: Safety Evals

Entities: AnthropicSafety Evals

OpenAI Evaluation Filter · October 27, 2025 10:00

Addendum to GPT-5 System Card: Sensitive conversations

This system card details GPT-5’s improvements in handling sensitive conversations, including new benchmarks for emotional reliance, mental health, and jailbreak resistance.

Topics: Benchmarks

Entities: Benchmarks