All-In with Chamath, Jason, Sacks & Friedberg

Podbit · All-In with Chamath, Jason, Sacks & Friedberg

Socialists Sweep NYC, China Catches Up in Coding, AI Memory Crunch, Micron's Blowout Quarter

Explore episode Jun 26, 2026
Technology
Distributed Inference Is Coming — But Distributed Training Needs Physical Proximity

Socialists Sweep NYC, China Catches Up in Coding, AI Memory… · Jun 26, 2026 Technology

Distributed training across physically separate locations is orders of magnitude less efficient — even 2 kilometers of fiber kills performance. But everything that kills distributed training is actually fine for inference. Distributed inference clouds are coming, and they could recycle unused compute from restaurants to homes.

Where this was said

The math behind distributed compute and datacenters in space

At 1:12:14 · chapter starts 1:10:17

Tesla's Megapod trademark filing suggests modular AI data centers at Supercharger stations. Travis describes putting compute in Adams restaurant kitchens. Debate over distributed training vs. inference efficiency constraints.

Similar podbits