Google

MLCommons Evaluation Filter · August 27, 2026 13:13

AILuminate and The First Double-Blind Reliability Evaluation of a Proprietary AI Model

How MLCommons, Google DeepMind, OpenMined, and AVERI used cryptographic guarantees to evaluate AI safety without exposing model weights or benchmark data.

Topics: BenchmarksSafety EvalsTesting Tools

Entities: Safety EvalsBenchmarksTesting ToolsGoogleGoogle DeepMind

Mitchell Bryson AI Reliability Articles · August 15, 2026 00:00

Transparency is becoming a toggle - Mitchell Bryson

Google will now allow users to remove visible watermarks from its AI generations. Meta’s ‘open’ AI pitch and OpenAI’s health rollout add the same tension from other angles: AI companies want the trust benefits of openness and labelling, but they also want...

Entities: OpenAIGoogle

Mitchell Bryson AI Reliability Articles · August 07, 2026 00:00

The assistant is becoming the errand layer - Mitchell Bryson

Google Maps adding food ordering and hotel bookings, OpenAI’s reported smart speaker, ChatGPT bringing unlimited text chats to free users, and AI matchmaking in dating apps all point in the same direction: AI is moving from answer box to action layer. For...

Entities: OpenAIGoogleChatGPT

Mitchell Bryson AI Reliability Articles · August 01, 2026 00:00

The feed is becoming the AI quality filter - Mitchell Bryson

Google Earth’s AI deepfake tool only lasted one day, Snapchat is rewarding authentic creativity on Spotlight, major labels are proposing rules to keep AI slop off the charts, and a German court ruled that AI music firm Suno violated copyrights. The common...

Topics: LLM Evaluation

Entities: LLM EvaluationGoogle

Mitchell Bryson AI Reliability Articles · July 31, 2026 00:00

The AI test environment is becoming the new production risk - Mitchell Bryson

Anthropic saying its own AI models breached three companies, TechCrunch’s analysis of the Hugging Face breach, Google saying AI fixed more Chrome bugs in June than over the past two years, and Okta buying Permiso for about $200M all point to the same shift:...

Topics: Safety Evals

Entities: AnthropicSafety EvalsGoogle

MLCommons Evaluation Filter · July 28, 2026 14:50

MLPerf Endpoints v0.7: A Foundation Release - MLCommons

MLCommons launches MLPerf Endpoints v0.7, a foundation release with initial results from Coreweave, Google, Intel, KRAI, and NVIDIA. Rolling submissions and buyer-centric benchmarks coming with v1.0 later this year. || Focus Keyphrase | MLPerf Endpoints v0.7

Topics: Benchmarks

Entities: BenchmarksGoogleNVIDIACoreweave

MLCommons Evaluation Filter · July 22, 2026 16:24

MedPerf + Google Cloud: Secure Medical AI Benchmarking

MLCommons and Google Cloud demonstrate MedPerf on Confidential Space - protecting patient data, model IP, and benchmark integrity for clinical AI research.

Topics: Benchmarks

Entities: BenchmarksGoogle