LMArena is a cancer on AI

kept by eddie jan 09

LMArena's human-voted leaderboard rewards superficiality and verbosity over factual accuracy, making it an unreliable metric for AI model quality.

Attention Required!
xAI releases Grok 4.1 with improved emotional intelligence, creative writing, reduced hallucinations, and top LMArena ranking.
also on LMArena, #ai
AI IQ — Intelligently Measuring AI Intelligence
The piece presents a methodology that maps public benchmark scores to IQ estimates across seven dimensions, enabling comparison of AI models by intelligence, speed, and cost.
also on #ai-evaluation, #benchmarks
AI evals are becoming the new compute bottleneck
AI evaluation costs now rival or exceed training costs, with agent benchmarks reaching $40,000 per sweep and training-in-the-loop evals resisting effective compression.
also on #ai-evaluation
8 plots that explain the state of open models
Qwen dominates open-model downloads and finetunes globally, while DeepSeek leads in large-scale models and GPT-OSS is the only Western contender gaining adoption.
also on #benchmarks, Meta, #open-source, #ai