Hard Fork

Snapshot · Hard Fork

‘Hard Fork’ Live, Part 3: Differing Visions of an A.I. Future

Explore episode Jun 19, 2026

Where this was said

AI History and the Risk of Transformer Groupthink

At 14:33 · chapter starts 14:30

The conversation turns to the track record of AI prediction. Casey notes that watching benchmarks get saturated repeatedly has made him more inclined to trust lab pronouncements. Kapoor counters with a cautionary tale from history: from the 1990s to 2010s, the entire AI research community dismissed neural networks as unserious — you could count the true believers on two hands. It took people like Fei-Fei Li, Geoffrey Hinton, Yann LeCun, and Yoshua Bengio — later Turing Award winners — to keep the faith. Kapoor suggests the current all-in bet on transformer architectures could be the new groupthink, with genuinely breakthrough architectures being sidelined. Kokotajlo's response: the AI community has been right to be bullish, and every claimed wall keeps getting smashed.

Technology
The Transformer Herding Problem: Is the AI Community Making the Same Mistake Again?

‘Hard Fork’ Live, Part 3: Differing Visions of an A.I. Futu… · Jun 19, 2026 Technology

The AI research community once dismissed neural networks as a joke for decades, only to be proven catastrophically wrong. Kapoor warns the same dynamic may be playing out today with transformer-based models — an entire field potentially missing the next architectural breakthrough.

Similar snapshots