Reading up on Eliezer Yudkowsky
4 deep · digging since jan 21
- They really do think AI might kill everyone
AI researchers genuinely believe there is a non‑trivial chance that superintelligent AI could cause human extinction, and they have discussed this risk for over a decade.
- Smuggled Infinities - by Ben Mathes - Adventure Capital
The article explains how activists smuggle infinite costs or benefits into arguments, using Pascal’s Wager, and shows how this leads to extreme decisions on climate, AI, and pandemics.
- Optimal Timing for Superintelligence
Nick Bostrom argues that even with high catastrophe risk, developing superintelligence quickly is worthwhile because it could radically extend human lifespan and cure aging.
- ChatGPT Self Portrait - by Zvi Mowshowitz
ChatGPT's self-portrait responses to a prompt about user treatment vary widely from friendly to abusive, highlighting framing dependence and raising questions about AI alignment and reciprocity.