All-In with Chamath, Jason, Sacks & Friedberg

Podbit · All-In with Chamath, Jason, Sacks & Friedberg

Open Source Wins, AGI Is Here, and Scorsese's AI Toolkit with CEOs of Cerebras & Black Forest Labs

Explore episode Jul 10, 2026
Technology
Latent Diffusion: The Algorithm Behind All Generative AI

Open Source Wins, AGI Is Here, and Scorsese's AI Toolkit wi… · Jul 10, 2026 Technology

Every major generative AI model for images, video, and physical AI runs on latent diffusion — invented by Robin Rombach and his co-founders as PhD students in Munich. The insight: compress natural data like images and video into efficient representations, then train a transformer on that. JPEG and MP3 principles, applied to generative intelligence.

Where this was said

The Innovation Behind Generative Video (Robin Rombach)

At 41:45 · chapter starts 40:54

Robin Rombach introduces himself and his company with a technical origin story that reframes the scope of what Black Forest Labs has built. He and his co-founders invented the latent diffusion algorithm as PhD students in Munich — a method that compresses natural data like images and video into efficient latent representations and trains a transformer model on that compressed space. The intuition is old (JPEG compression, MP3 audio encoding) but the application to generative AI was new. From that foundation came Stable Diffusion, and from Stable Diffusion came Black Forest Labs and Flux. Now, two years in and past 100 employees, the company is pushing into territory that goes far beyond images: multimodal models that simultaneously process images, video, and audio as both inputs and outputs — and can generate content in any of those modalities. The next frontier is action prediction: using the same model to predict physical robot actions, bridging generative AI and the real world.

Similar podbits