The a16z Show

Snapshot · The a16z Show

Sriram Krishnan on Open Source AI's Biggest Week Yet

Explore episode Jul 24, 2026

Where this was said

The Distillation Debate: AI Slop, Reasoning Traces, and the Asymmetric Playing Field

At 19:38 · chapter starts 19:25

The distillation debate is one of the episode's richest segments. Krishnan starts by resetting the framing: distillation — learning from the outputs of other models — has been foundational to AI development since the beginning. Every model from the original GPT to Claude bootstrapped itself from human knowledge crawled off the internet. And now much of that internet is itself AI-generated (AI slop), which feeds back into training. Krishnan amusingly reveals he once ran his own tweet through an AI detector to confirm it read as human-written. The real issue, he argues, isn't distillation per se — it's the asymmetry. Chinese AI developers can freely harvest reasoning traces from American frontier models, while U.S. startups face genuine legal uncertainty about whether they can distill from other American models. He credits Sequoia's Dean Meyer for articulating this clearly in a recent post, and Ben Thompson of Stratechery for reaching a similar conclusion independently. The solution: enshrine distillation rights for American model developers to level the playing field. The irony he notes in passing: current American open-weight models themselves use Chinese models as teacher models in fine-tuning, highlighting just how entangled global AI development has become.

Similar snapshots