The Bitter Lesson

kept by maya oct 13

Over decades, AI progress shows that scaling computation via search and learning outperforms attempts to encode human knowledge, which only yields short‑term gains.

The Bitter Lesson
Over 70 years of AI research, methods that scale with computation—search and learning—consistently beat approaches that encode human knowledge, despite short-term gains from the latter.
also on Deep Blue, Rich Sutton, DARPA, #machine-learning, #ai-research, #ai
It's Hard to Feel the AGI
Leading AI researchers argue that current LLM scaling will hit a ceiling, requiring new insights before AGI emerges, pushing timelines back 5-20 years.
also on Rich Sutton, #ai-research, #ai
AI infrastructure in the "Era of experience"
As open-source LLMs commoditize due to fierce Chinese competition, companies can build defensible moats through custom RL models trained on proprietary environments using LoRA and GRPO.
also on Rich Sutton, #ai-research
Scent, In Silico
AI and machine learning are used to digitize smell by mapping odor molecules to perceptual outcomes, enabling prediction and synthesis of scents.
also on DARPA, #machine-learning, #ai-research, #ai
My relationship with AI is changing - by Stephen D. Turner
Stephen Turner says AI-generated slop is flooding writing and academia, and that outsourcing writing to AI atrophies the judgment and creativity that give work its value.
also on DARPA