Safety Evals

OpenAI Evaluation Filter · January 31, 2024 08:00

Building an early warning system for LLM-aided biological threat creation

We’re developing a blueprint for evaluating the risk that a large language model (LLM) could aid someone in creating a biological threat. In an evaluation involving both biology experts and students, we found that GPT-4 provides at most a mild uplift in...

Topics: Safety Evals

Entities: Safety Evals

OpenAI Evaluation Filter · October 26, 2023 07:00

Frontier risk and preparedness

To support the safety of highly-capable AI systems, we are developing our approach to catastrophic risk preparedness, including building a Preparedness team and launching a challenge.

Topics: Safety Evals

Entities: Safety Evals