Capabilities
AI Benchmarks Explained: What the Scores Actually Mean
Contamination, saturation, prompt sensitivity, and averaging. Four reasons a leaderboard number tells you less than ten minutes with the test items.
1 article on Emergent Wire tagged "leaderboards."
1 article
Contamination, saturation, prompt sensitivity, and averaging. Four reasons a leaderboard number tells you less than ten minutes with the test items.