asteriskmag.substack.com
The most important number in AI
Epoch AI's ECI uses item response theory to aggregate benchmark scores into a single capability metric, but benchmark selection, reward hacking, and ceiling effects pose ongoing challenges.
One line. Many voicesSeek and you shall find
asteriskmag.substack.com
Epoch AI's ECI uses item response theory to aggregate benchmark scores into a single capability metric, but benchmark selection, reward hacking, and ceiling effects pose ongoing challenges.