Google News LLM Evaluation
A review of model evaluation metrics for machine learning in genetics and genomics - Frontiers
A review of model evaluation metrics for machine learning in genetics and genomics Frontiers
Community feed
evald.ai
A focused stream of recent stories from the sources curated for this community. Latest: A review of model evaluation metrics for machine learning in genetics and genomics - Frontiers, Vivaria, and Details about METR's preliminary evaluation of GPT-4o. Page 24.
Search
METR Blog
Vivaria
Vivaria is METR's tool for running evaluations and conducting agent elicitation research. Vivaria is a web application with which users can interact using a web UI and a command-line interface.
METR Blog
Details about METR's preliminary evaluation of GPT-4o
We measured the performance of GPT-4o given a simple agent scaffolding on 77 tasks across 30 task families testing autonomous capabilities.
METR Blog
An update on our general capability evaluations
More tasks, human baselines, and preliminary results for GPT-4 and Claude.
Hugging Face Evaluation Filter
LAVE: Zero-shot VQA Evaluation on Docmatix with LLMs - Do We Still Need Fine-Tuning?
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
OpenAI Evaluation Filter
OpenAI and Los Alamos National Laboratory announce research partnership
OpenAI and Los Alamos National Laboratory are working to develop safety evaluations to assess and measure biological capabilities and risks associated with frontier models.
Hugging Face Evaluation Filter
Our Transformers Code Agent beats the GAIA benchmark 🏅
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Hugging Face Evaluation Filter
Ethics and Society Newsletter #6: Building Better AI: The Importance of Data Quality
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
OpenAI Evaluation Filter
Improved Techniques for Training Consistency Models
Consistency models are a nascent family of generative models that can sample high quality data in one step without the need for adversarial training.
Hugging Face Evaluation Filter
Launching the Artificial Analysis Text to Image Leaderboard & Arena
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
METR Blog
ERROR: The request could not be satisfied
Comments on NIST’s draft document “AI Risk Management Framework: Generative AI Profile.”
Hugging Face Evaluation Filter
CyberSecEval 2 - A Comprehensive Evaluation Framework for Cybersecurity Risks and Capabilities of Large Language Models
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
More stories
More stories load automatically as you scroll.