OpenAI Evaluation Filter

OpenAI Evaluation Filter · April 10, 2025 10:00

BrowseComp: a benchmark for browsing agents

BrowseComp: a benchmark for browsing agents.

Topics: Benchmarks

Entities: Benchmarks

OpenAI Evaluation Filter · April 02, 2025 10:15

PaperBench: Evaluating AI’s Ability to Replicate AI Research

We introduce PaperBench, a benchmark evaluating the ability of AI agents to replicate state-of-the-art AI research.

Topics: Benchmarks

Entities: Benchmarks

OpenAI Evaluation Filter · March 31, 2025 15:00

New funding to build towards AGI

Today we’re announcing new funding—$40B at a $300B post-money valuation, which enables us to push the frontiers of AI research even further, scale our compute infrastructure, and deliver increasingly powerful tools for the 500 million people who use ChatGPT...

Entities: ChatGPT

OpenAI Evaluation Filter · February 18, 2025 10:00

Introducing the SWE-Lancer benchmark

Can frontier LLMs earn $1 million from real-world freelance software engineering?

Topics: Benchmarks

Entities: Benchmarks

OpenAI Evaluation Filter · January 31, 2025 11:00

OpenAI o3-mini System Card

This report outlines the safety work carried out for the OpenAI o3-mini model, including safety evaluations, external red teaming, and Preparedness Framework evaluations.

Topics: Safety Evals

Entities: Safety EvalsOpenAI

OpenAI Evaluation Filter · January 23, 2025 10:00

Operator System Card

Drawing from OpenAI’s established safety frameworks, this document highlights our multi-layered approach, including model and product mitigations we’ve implemented to protect against prompt engineering and jailbreaks, protect privacy and security, as well...

Entities: OpenAI

OpenAI Evaluation Filter · December 05, 2024 10:00

OpenAI o1 System Card

This report outlines the safety work carried out prior to releasing OpenAI o1 and o1-mini, including external red teaming and frontier risk evaluations according to our Preparedness Framework.

Topics: Safety Evals

Entities: Safety EvalsOpenAI

OpenAI Evaluation Filter · October 30, 2024 10:00

Introducing SimpleQA

A factuality benchmark called SimpleQA that measures the ability for language models to answer short, fact-seeking questions.

Topics: Benchmarks

Entities: Benchmarks

OpenAI Evaluation Filter · October 23, 2024 10:00

Simplifying, stabilizing, and scaling continuous-time consistency models

We’ve simplified, stabilized, and scaled continuous-time consistency models, achieving comparable sample quality to leading diffusion models, while using only two sampling steps.

Topics: LLM Evaluation

Entities: LLM Evaluation

OpenAI Evaluation Filter · October 10, 2024 10:00

MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering

We introduce MLE-bench, a benchmark for measuring how well AI agents perform at machine learning engineering.

Topics: Benchmarks

Entities: Benchmarks