Dwarkesh Podcast

Podbit · Dwarkesh Podcast

8 Predictions for the Era of Continual Learning

Explore episode Aug 7, 2026
Technology
Prediction 8: Inference Economies of Scale Will Favor Big Enterprises

8 Predictions for the Era of Continual Learning · Aug 7, 2026 Technology

Serving personalized AI weights efficiently requires batching thousands of sequences simultaneously — the optimal batch size for a sparse model like DeepSeek V3 exceeds 2,400. Individual users running batch size 1 face more than 100x worse compute efficiency, meaning the economics of personalized AI strongly favor large organizations.

Similar podbits

Technology
Prediction 2: Technical Alignment Must Solve for Constantly Shifting Weights

8 Predictions for the Era of Continual Learning · Aug 7, 2026 Technology

Almost no alignment research addresses the hardest version of the problem: keeping an AI safe when its weights are being updated continuously from millions of real-world sessions. This is structurally similar to the human parenting problem — you need to give the system enough foundational values that it improves without going off the rails.