Steven Bartlett asked whether Kokotajlo would press a button permanently shutting down all frontier AI training. He said he'd slam a temporary pause button immediately. The permanent one? He would probably not press it — but only because he still believes there's a chance AI could produce enormous benefits for humanity, and because human civilisation is fragile with or without AI.