OpenAI Evaluation Filter
OpenAI introduces IndQA, a new benchmark for evaluating AI systems in Indian languages. Built with domain experts, IndQA tests cultural understanding and reasoning across 12 languages and 10 knowledge areas.
Topics: Benchmarks
Entities: BenchmarksOpenAI
OpenAI Evaluation Filter
gpt-oss-safeguard-120b and gpt-oss-safeguard-20b are two open-weight reasoning models post-trained from the gpt-oss models and trained to reason from a provided policy in order to label content under that policy. In this report, we describe...
OpenAI Evaluation Filter
This system card details GPT-5’s improvements in handling sensitive conversations, including new benchmarks for emotional reliance, mental health, and jailbreak resistance.
Topics: Benchmarks
Entities: Benchmarks
OpenAI Evaluation Filter
Learn how OpenAI uses AI to enhance support, cutting response times, improving quality, and scaling to meet hypergrowth.
Topics: LLM Evaluation
Entities: LLM EvaluationOpenAI
OpenAI Evaluation Filter
OpenAI introduces GDPval, a new evaluation that measures model performance on real-world economically valuable tasks across 44 occupations.
Entities: OpenAI
OpenAI Evaluation Filter
Apollo Research and OpenAI developed evaluations for hidden misalignment (“scheming”) and found behaviors consistent with scheming in controlled tests across frontier models. The team shared concrete examples and stress tests of an early method to reduce...
Entities: OpenAI
OpenAI Evaluation Filter
OpenAI’s new research explains why language models hallucinate. The findings show how improved evaluations can enhance AI reliability, honesty, and safety.
Topics: Testing Tools
Entities: Testing ToolsOpenAI
OpenAI Evaluation Filter
OpenAI and Anthropic share findings from a first-of-its-kind joint safety evaluation, testing each other’s models for misalignment, instruction following, hallucinations, jailbreaking, and more—highlighting progress, challenges, and the value of cross-lab...
Topics: Testing Tools
Entities: AnthropicTesting ToolsOpenAI
OpenAI Evaluation Filter
Discover how Intercom built a scalable AI platform with 3 key lessons—from evaluations to architecture—to lead the future of customer support.
OpenAI Evaluation Filter
ChatGPT agent System Card: OpenAI’s agentic model unites research, browser automation, and code tools with safeguards under the Preparedness Framework.
Topics: Safety Evals
Entities: Safety EvalsOpenAIChatGPT
OpenAI Evaluation Filter
HealthBench is a new evaluation benchmark for AI in healthcare which evaluates models in realistic scenarios. Built with input from 250+ physicians, it aims to provide a shared standard for model performance and safety in health.
Topics: Benchmarks
Entities: Benchmarks
OpenAI Evaluation Filter
Sharing our updated framework for measuring and protecting against severe harm from frontier AI capabilities.
Topics: Safety Evals
Entities: Safety Evals