Google DeepMind Evaluation Filter

Google DeepMind Evaluation Filter August 27, 2026 12:59

Piloting the world's first double-blind AI evaluations

Building trust in proprietary model benchmarks using cryptographically secure environments

Topics: Benchmarks

Entities: Benchmarks

Google DeepMind Evaluation Filter June 10, 2026 10:21

Google DeepMind and partners announce multi-agent safety research funding call.

Google DeepMind and partners are announcing a new technical research funding call of up to $10M for researchers worldwide to strengthen multi-agent safety.

Entities: Google Google DeepMind

Google DeepMind Evaluation Filter March 25, 2026 16:46

Protecting People from Harmful Manipulation

Google DeepMind releases new findings and an evaluation framework to measure AI's potential for harmful manipulation in areas like finance and health, with the goal of enhancing AI safety.

Topics: Safety Evals Testing Tools

Entities: Safety Evals Testing Tools Google Google DeepMind

Google DeepMind Evaluation Filter March 17, 2026 16:03

Measuring progress toward AGI: A cognitive framework

Google DeepMind proposes a cognitive framework to evaluate AGI and launches a Kaggle hackathon to build capability benchmarks

Topics: Benchmarks

Entities: Benchmarks Google Google DeepMind

Google DeepMind Evaluation Filter December 16, 2025 10:14

Gemma Scope 2: Helping the AI Safety Community Deepen Understanding of Complex Language Model Behavior

Announcing Gemma Scope 2, a comprehensive, open suite of interpretability tools for the entire Gemma 3 family to accelerate AI safety research.

Topics: Safety Evals

Entities: Safety Evals

Google DeepMind Evaluation Filter December 11, 2025 00:06

Deepening AI Safety Research with UK AI Security Institute (AISI)

Google DeepMind and the UK AI Security Institute (AISI) strengthen collaboration through a new research partnership, focusing on critical safety research areas like monitoring AI reasoning and evalua…

Topics: Safety Evals

Entities: Safety Evals Google Google DeepMind

Google DeepMind Evaluation Filter December 09, 2025 11:29

FACTS Benchmark Suite: a new way to systematically evaluate LLMs factuality

The FACTS Benchmark Suite provides a systematic evaluation of Large Language Models (LLMs) factuality across three areas: Parametric, Search, and Multimodal reasoning.

Topics: Benchmarks

Entities: Benchmarks

Google DeepMind Evaluation Filter October 23, 2025 23:44

Google DeepMind strengthens the Frontier Safety Framework

Today, we’re publishing the third iteration of our Frontier Safety Framework (FSF) — our most comprehensive approach yet to identifying and mitigating severe risks from advanced AI models. This updat…

Entities: Google Google DeepMind

Google DeepMind Evaluation Filter October 23, 2025 18:52

Rethinking how we measure AI intelligence

Kaggle Game Arena is a new platform where AI models compete head-to-head in complex strategic games.

Google DeepMind Evaluation Filter April 02, 2025 13:31

Taking a responsible path to AGI

We’re exploring the frontiers of AGI, prioritizing technical safety, proactive risk assessment, and collaboration with the AI community.

Topics: Safety Evals

Entities: Safety Evals