Quote · Dwarkesh Podcast
8 Predictions for the Era of Continual Learning
Where this was said
Prediction 1: Current AI Regulation Will Become Obsolete
At 2:15 · chapter starts 1:15
Patel's first prediction attacks a foundational assumption of current AI governance: that there is a meaningful, inspectable moment between training and deployment where safety checks can be applied. This assumption already feels shaky, but under continual learning it collapses entirely [1] — Dwarkesh Patel "Current AI safety regulation is built around checking a model before it deploys. But if models improve daily from millions of sessions, tha…" 01:15 . If a model is updating its weights based on millions of daily sessions, it is effectively a different model every day — making any single pre-deployment audit both incomplete and quickly stale. Worse, locking in today's regulatory regime could prove actively counterproductive, enshrining an archaic approach to risks that will have fundamentally changed in character. Patel's pragmatic alternative: shift safety oversight to ongoing monthly or quarterly risk inspections, which can adapt to an ever-evolving model rather than pretending there's one fixed artifact to approve.
Current AI safety regulation is built around checking a model before it deploys. But if models improve daily from millions of sessions, that pre-deployment checkpoint becomes meaningless — and locking in today's regulatory framework could be actively counterproductive.
Patel recommends monthly or quarterly AI risk inspections rather than a single pre-deployment check, since continual learning makes the train/deploy boundary meaningless.
Almost no alignment research addresses the hardest version of the problem: keeping an AI safe when its weights are being updated continuously from millions of real-world sessions. This is structurally similar to the human parenting problem — you need to give the system enough foundational values that it improves without going off the rails.
