evald.ai

Hacker News LLM Evaluation · February 19, 2026 13:18

LLM Evaluation Tool — Compare Models, Prompts & Configs | Valohai

Compare LLM models side by side with 3 lines of Python. Track evaluations across GPT, Claude, Llama and any model. Radar charts, scorecards, real-time streaming. Free forever.

Topics: LLM Evaluation

Entities: ClaudeLLM Evaluation

METR Blog · February 19, 2026 08:00

Five lessons from having helped run an AI-Biology RCT

Luca Righetti shares takeaways on the role of randomized controlled trials in AI safety testing.

Topics: Safety EvalsTesting Tools

Entities: Safety EvalsTesting Tools

OpenAI Evaluation Filter · February 18, 2026 00:00

Introducing EVMbench

OpenAI and Paradigm introduce EVMbench, a benchmark evaluating AI agents’ ability to detect, patch, and exploit high-severity smart contract vulnerabilities.

Topics: Benchmarks

Entities: BenchmarksOpenAI

METR Blog · February 18, 2026 00:00

How We Protect Confidential Information

Our high-level approach to protecting confidential access and information

METR Blog · February 17, 2026 08:00

Analyzing coding agent transcripts to upper bound productivity gains from AI agents

Amy Deng investigates whether coding agent transcripts could serve as an alternative for estimating AI productivity uplift, using 5305 Claude Code transcripts from METR technical staff.

Entities: ClaudeClaude Code

METR Blog · February 13, 2026 08:00

Measuring Time Horizon using Claude Code and Codex

Nikola Jurkovic describes our measurements of time horizon using Claude Code and Codex scaffolds.

Entities: ClaudeClaude Code

METR Blog · February 10, 2026 08:00

A simpler AI timelines model predicts 99% AI R&D automation in ~2032

Thomas Kwa describes a simple model for forecasting when AI will automate AI development, based on the AI Futures model but with only 8 parameters.