Distributed training across physically separate locations is orders of magnitude less efficient — even 2 kilometers of fiber kills performance. But everything that kills distributed training is actually fine for inference. Distributed inference clouds are coming, and they could recycle unused compute from restaurants to homes.