Topic feed
Evaluation frameworks, graders, and AI testing infrastructure.
Google News LLM Evaluation
AI Model Evaluation Platform Market Research Report 2026: AWS, Google, Microsoft and IBM Set Industry Standards for Performance and Reliability - Long-term Forecast to 2030 and 2035 Yahoo Finance
Google DeepMind Evaluation Filter
Google DeepMind releases new findings and an evaluation framework to measure AI's potential for harmful manipulation in areas like finance and health, with the goal of enhancing AI safety.
METR Blog
Luca Righetti shares takeaways on the role of randomized controlled trials in AI safety testing.
Google News LLM Evaluation
NIST Seeks Public Input on Draft Best Practices for Automated AI Benchmark Testing ExecutiveGov
OpenAI Evaluation Filter
OpenAI introduces FrontierScience, a benchmark testing AI reasoning in physics, chemistry, and biology to measure progress toward real scientific research.
OpenAI Evaluation Filter
OpenAI introduces a real-world evaluation framework to measure how AI can accelerate biological research in the wet lab. Using GPT-5 to optimize a molecular cloning protocol, the work explores both the promise and risks of AI-assisted experimentation.
Google News LLM Evaluation
Polish emerges as top language in multilingual AI benchmark testing PPC Land
OpenAI Evaluation Filter
OpenAI’s new research explains why language models hallucinate. The findings show how improved evaluations can enhance AI reliability, honesty, and safety.
OpenAI Evaluation Filter
OpenAI and Anthropic share findings from a first-of-its-kind joint safety evaluation, testing each other’s models for misalignment, instruction following, hallucinations, jailbreaking, and more—highlighting progress, challenges, and the value of cross-lab...
Google News LLM Evaluation
MLPerf Client 1.0 AI benchmark released — new testing toolkit sports a GUI, covers more models and tasks, and supports more hardware acceleration paths Tom's Hardware
METR Blog
Why pre-deployment testing is not an adequate framework for AI risk management
METR Blog
We measured the performance of GPT-4o given a simple agent scaffolding on 77 tasks across 30 task families testing autonomous capabilities.