Google News LLM Evaluation
Polish emerges as top language in multilingual AI benchmark testing - PPC Land
Polish emerges as top language in multilingual AI benchmark testing PPC Land
Concept
Testing Tools
OpenAI Evaluation Filter
Why language models hallucinate
OpenAI’s new research explains why language models hallucinate. The findings show how improved evaluations can enhance AI reliability, honesty, and safety.
OpenAI Evaluation Filter
Findings from a pilot Anthropic–OpenAI alignment evaluation exercise: OpenAI Safety Tests
OpenAI and Anthropic share findings from a first-of-its-kind joint safety evaluation, testing each other’s models for misalignment, instruction following, hallucinations, jailbreaking, and more—highlighting progress, challenges, and the value of cross-lab...
Google News LLM Evaluation
MLPerf Client 1.0 AI benchmark released — new testing toolkit sports a GUI, covers more models and tasks, and supports more hardware acceleration paths - Tom's Hardware
MLPerf Client 1.0 AI benchmark released — new testing toolkit sports a GUI, covers more models and tasks, and supports more hardware acceleration paths Tom's Hardware
METR Blog
AI models can be dangerous before public deployment
Why pre-deployment testing is not an adequate framework for AI risk management
METR Blog
Details about METR's preliminary evaluation of GPT-4o
We measured the performance of GPT-4o given a simple agent scaffolding on 77 tasks across 30 task families testing autonomous capabilities.
Hugging Face Evaluation Filter
CyberSecEval 2 - A Comprehensive Evaluation Framework for Cybersecurity Risks and Capabilities of Large Language Models
We’re on a journey to advance and democratize artificial intelligence through open source and open science.