Google

Google DeepMind Evaluation Filter · March 17, 2026 16:03

Measuring progress toward AGI: A cognitive framework

Google DeepMind proposes a cognitive framework to evaluate AGI and launches a Kaggle hackathon to build capability benchmarks

Benchmarks

Benchmarks Google Google DeepMind

Mitchell Bryson AI Reliability Articles · March 12, 2026 00:00

The agent stack just got its operating system - Mitchell Bryson

In a single week, every layer of the AI agent stack advanced simultaneously: Microsoft shipped Agent 365 as an enterprise control plane for governing fleets of AI agents, Google open-sourced ADK for TypeScript so web developers can build multi-agent...

Google Microsoft

Mitchell Bryson AI Reliability Articles · February 27, 2026 00:00

Google DeepMind Unveils Nano Banana 2: Revolutionary AI Image Generator Democratizes Professional Creation - Mitchell Bryson

Google DeepMind launched Nano Banana 2 (Gemini 3.1 Flash Image), blending high-quality outputs with unprecedented speed to democratize professional-grade image creation across Google's product suite.

LLM Evaluation

LLM Evaluation Gemini Google Google DeepMind

Google DeepMind Evaluation Filter · December 11, 2025 00:06

Deepening AI Safety Research with UK AI Security Institute (AISI)

Google DeepMind and the UK AI Security Institute (AISI) strengthen collaboration through a new research partnership, focusing on critical safety research areas like monitoring AI reasoning and evalua…

Safety Evals

Safety Evals Google Google DeepMind

Google DeepMind Evaluation Filter · October 23, 2025 23:44

Google DeepMind strengthens the Frontier Safety Framework

Today, we’re publishing the third iteration of our Frontier Safety Framework (FSF) — our most comprehensive approach yet to identifying and mitigating severe risks from advanced AI models. This updat…

Google Google DeepMind

Hacker News LLM Evaluation · August 27, 2025 18:52

Stop “vibe testing” your LLMs. It's time for real evals.- Google Developers Blog

Explore Stax, an experimental developer tool that streamlines LLM evaluation with human labelling and scalable LLM-as-a-judge auto-raters for data driven decisions.

LLM Evaluation Testing Tools

Testing Tools LLM Evaluation Google

METR Blog · August 22, 2025 07:00

Claude, GPT, and Gemini All Struggle to Evade Monitors

Vincent Cheng and Thomas Kwa replicate a Google DeepMind paper on chain-of-thought monitoring, showing evidence that monitoring works on other companies' models.

Claude Gemini Google Google DeepMind