Reading up on Humanity's Last Exam
2 deep · digging since feb 18
- Search Capability Leaderboard
Parallel evaluates models' web-search ability by combining DeepSearchQA, Humanity's Last Exam, and its WISER benchmark, measuring accuracy, lift, cost, speed, and Pareto efficiency.
- The AI Quality Ceiling: Why Domain Expertise Is Appreciating - philippdubach.com
AI output quality converges to the mean due to structural limits in next-token prediction, RLHF, and model collapse, making domain expertise more valuable as humans catch AI's subtle errors.