Community feed
A focused stream of recent stories from the sources curated for this community. Latest: MLCommons Releases MLPerf Client v1.6 with Performance Optimizations and Enhanced User Experience - MLCommons, MLCommons Releases New MLPerf Inference v6.0 Benchmark Results - MLCommons, and Fine-tuning experiments on CoT controllability. Page 10.
MLCommons Evaluation Filter
MLCommons releases MLPerf Client v1.6 with updated Windows ML and llama.cpp support, Apple MLX improvements for Mac and iPad, and usability enhancements for faster, more reliable AI benchmarking on personal computers.
MLCommons Evaluation Filter
MLCommons releases MLPerf Inference v6.0 results — the most significant benchmark update to date, with new tests for text-to-video, GPT-OSS 120B, DLRMv3, vision-language models, and YOLOv11
METR Blog
We find that a small amount of fine-tuning on instruction following in the CoT generalizes to meaningful increases in CoT controllability on an out-of-distribution set of tasks. We fine-tune four reasoning models on small datasets of instruction-following...
Google News LLM Evaluation
EPIC Joins Coalition Comment on NIST Guidance on AI Benchmark Evaluation EPIC – Electronic Privacy Information Center
Mitchell Bryson AI Reliability Articles
In a single week, OpenAI killed Sora ($15M/day burn, $2.1M lifetime revenue), blindsided Disney on a $1B deal, shelved its adult chatbot, renamed its product org to 'AGI Deployment,' moved safety oversight away from the CEO, and bet everything on a model...
Google News LLM Evaluation
AI benchmark helps robots plan and complete their chores in the real world Tech Xplore
Mitchell Bryson AI Reliability Articles
Google launched tools to import your ChatGPT memories and chat histories. Apple is turning Siri into a marketplace where every AI assistant plugs in — for a 30% cut. OpenAI is wiring Codex into every work tool you touch. Shopify made every AI conversation a...
Mitchell Bryson AI Reliability Articles
Anthropic's accidental Mythos reveal crashed cybersecurity stocks — but the market was catching up to a reality that was already here. On the same day, CISA warned of active exploitation of AI agent frameworks, researchers disclosed basic vulnerabilities in...
Mitchell Bryson AI Reliability Articles
In a single 48-hour stretch, Apple revealed plans to open Siri to rival chatbots, Mistral shipped an open-source voice model rivaling ElevenLabs, Google launched studio-quality AI music generation, and IBM embedded voice AI into enterprise agents. The chat...
Google News LLM Evaluation
Is AGI Here? Not Even Close, New AI Benchmark Suggests Decrypt
Google News LLM Evaluation
The toughest AI benchmark just got a whole lot tougher Sherwood News
METR Blog
A METR staff member spent three weeks red-teaming a subset of Anthropic's internal agent monitoring and security systems, discovering several novel vulnerabilities.
More stories load automatically as you scroll.