Dwarkesh Podcast

Podbit · Dwarkesh Podcast

The data black hole at the center of AI

Explore episode Jun 19, 2026

Where this was said

Comparing human vs AI sample efficiency

At 5:48 · chapter starts 3:11

Three objections addressed: (1) evolution pre-training humans — debunked via genome size; (2) multimodal sensory data — debunked via blind/deaf intelligence; and (3) scaling up models — addressed next.

Technology
The Million-Fold Data Gap

The data black hole at the center of AI · Jun 19, 2026 Technology

Frontier AI models are trained on tens to hundreds of trillions of tokens. A human sees about 200 million from birth to adulthood. That's close to a million-fold difference — and it reveals just how data-hungry these systems really are.

Technology
A Teenager vs. Waymo: The Driving Data Gap

The data black hole at the center of AI · Jun 19, 2026 Technology

A teenager learns to drive in 20 hours. Even accounting for 16 years of growing up and building physical intuition, that's still 3–4 orders of magnitude less data than Waymo and Tesla use to train self-driving cars. This gap is the sample efficiency problem in concrete terms.

Science
Evolution Didn't Pre-Train Us

The data black hole at the center of AI · Jun 19, 2026 Science

The common objection — that billions of years of evolution pre-trained humans, making data comparisons unfair — doesn't hold up. The human genome is only 3 GB, and 1–2% is protein-coding. That's nowhere near enough to store pre-trained neural network weights. Evolution found the right hyperparameters; it didn't train the weights.

Similar podbits

Science
Microplastics: Were We Measuring Them Wrong?

“This Is The Culmination Of Everything I Know” - Dr Andrew … · Sep 14, 2026 Science

The widely shared claim that we have a credit card's worth of plastic in our brains may be a massive overestimate. Researchers used nitrile gloves to measure microplastics — and nitrile gloves shed microplastic particles onto the measuring device. A second paper found the original tool used was unreliable, and that we may have far less plastic than reported.

Science
The Door-Keeping Experiment: Our Irrational Addiction to Optionality

Finding Your Life Path, Solved · Sep 2, 2026 Science

In Dan Ariely's door experiment, participants sacrificed the highest-reward door — repeatedly — just to avoid seeing other doors disappear. Even when researchers trained them to use the best door, they kept wasting clicks to maintain options. This is the bias that runs our lives: we'll take a worse outcome to preserve the feeling of optionality.

Science
Dan Gilbert's Psychological Immune System: Why Your Brain Justifies Every Decision

Finding Your Life Path, Solved · Sep 2, 2026 Science

Dan Gilbert discovered that the brain has a 'psychological immune system' — it misremembers, reframes, and rationalizes to keep you satisfied with whatever you chose. The fear before commitment is all about potential regret. But after committing, your brain quietly starts justifying the choice — and the more irreversible the decision, the stronger the effect.

Science
The Placebo Effect Is Not Fake — It Just Belongs to the Story, Not the Drug

#403 ‒ Peptides: separating scientific promise from marketi… · Aug 10, 2026 Science

Peptides come loaded with a powerful narrative: regenerative, subcutaneous, targeted, cutting-edge. That narrative can genuinely move outcomes, especially for pain, energy, and recovery. The RCT's job is to quantify how much additional benefit comes from the molecule itself — above and beyond the compelling story surrounding it.