Reading up on compute-cost
1 deep · digging since apr 30
- AI evals are becoming the new compute bottleneck
AI evaluation costs now rival or exceed training costs, with agent benchmarks reaching $40,000 per sweep and training-in-the-loop evals resisting effective compression.