Why The AI Doomers Might Be Right - Robert Wright - #1122

Where this was said

The Most Legitimate AI Doom Concerns

At 35:10 · chapter starts 33:00

Wright shifts from philosophical framework to concrete risk inventory. His most confident near-term concern is the sheer social disruption of rapid job loss — not because he believes everyone will ultimately be worse off, but because the disorientation of transition happens regardless of final outcomes. Beyond this, he lists AI-enabled bioweapon development as a serious near-term threat, a self-replicating AI system (like the Mythos scenario, a super-hacking AI that jumps from data centre to data centre) as a medium-term existential concern, and the generalised earthquake of social destabilisation that he regards as almost inevitable. He notes a particular frustration: every proposed regulatory measure — including modest interventions like taxing data centres for carbon costs — is met by Silicon Valley with the same reflexive argument: 'We can't do it because of China.' Wright finds this deeply unsatisfying. Sam Altman's dismissal of copyright concerns on speed grounds draws a pointed comparison: speed limits also slow things down, and society accepts them. Wright's position is that the national competition frame is itself largely a product of misconceptions and escalating mutual fear that could in principle be reduced.