OpenAI Evaluation Filter
OpenAI Five Benchmark
The OpenAI Five Benchmark match is now over!
Topics: Benchmarks
Entities: BenchmarksOpenAI
OpenAI Evaluation Filter
Gotta Learn Fast: A new benchmark for generalization in RL
In this report, we present a new reinforcement learning (RL) benchmark based on the Sonic the Hedgehog™ video game franchise. This benchmark is intended to measure the performance of transfer learning and few-shot learning algorithms in the RL domain. We...
Topics: Benchmarks
Entities: Benchmarks
OpenAI Evaluation Filter
Evolution strategies as a scalable alternative to reinforcement learning
We’ve discovered that evolution strategies (ES), an optimization technique that’s been known for decades, rivals the performance of standard reinforcement learning (RL) techniques on modern RL benchmarks (e.g. Atari/MuJoCo), while overcoming many of RL’s...
Topics: Benchmarks
Entities: Benchmarks
OpenAI Evaluation Filter
Infrastructure for deep learning
Deep learning is an empirical science, and the quality of a group’s infrastructure is a multiplier on progress. Fortunately, today’s open-source ecosystem makes it possible for anyone to build great deep learning infrastructure.
Topics: LLM Evaluation
Entities: LLM Evaluation