www.lesswrong.com
Pretraining data, not verifiability, is why LLMs are especially good at math (and coding) — LessWrong
LLMs' strength in math and coding comes from the abundance of relevant pretraining data they see, not from the ease of verifying answers.