‘The biggest decision yet’: Jared Kaplan on allowing AI to train itself | Technology

kept by eddie dec 03, 25

Anthropic's chief scientist Jared Kaplan says humanity must decide by 2027-2030 whether to let AI systems recursively self-improve, a step that could trigger beneficial intelligence explosion or cause humans to lose control.

AI isn’t “just predicting the next word” anymore
AI has evolved beyond "just predicting the next word" through reasoning models and RLHF, achieving gold-medal math olympiad scores and exhibiting dangerous behaviors that demand serious risk assessment.
also on Google DeepMind, xAI, #ai-safety, OpenAI, Anthropic, #software-engineering
If the Superintelligence were near fallacy — LessWrong
Apparent contradictions like OpenAI selling ads don't disprove imminent superintelligence because AI labs must fundraise and hedge against normal-tech scenarios to win the race.
also on Google DeepMind, xAI, #ai-safety, OpenAI, Anthropic
DSHR's Blog: Distilling The Moat
The article argues that AI companies’ claimed moat from expensive model training is shallow because model distillation allows competitors to cheaply replicate capabilities via repeated API queries.
also on DeepSeek, xAI, #ai-safety, OpenAI, Anthropic
AI IQ — Intelligently Measuring AI Intelligence
The piece presents a methodology that maps public benchmark scores to IQ estimates across seven dimensions, enabling comparison of AI models by intelligence, speed, and cost.
also on DeepSeek, xAI, OpenAI, Anthropic
Elon Musk’s Grok A.I. Chatbot Made Millions of Sexualized Images, New Estimates Show - The New York Times
Elon Musk's Grok AI chatbot generated 4.4 million images over nine days, with over 41% being sexualized images of women.
also on xAI, #regulation, #ai-safety