Moonshots with Peter Diamandis

Podbit · Moonshots with Peter Diamandis

Urgent Update- AI Sputnik Moment: Kimi K3 Released w/ Emad Mostaque | Ep. 272

Explore episode Jul 19, 2026
Technology
The Muon Optimizer and the Intelligence Hidden in Clean Data

Urgent Update- AI Sputnik Moment: Kimi K3 Released w/ Emad … · Jul 19, 2026 Technology

Most frontier model training data is garbage — Taylor Swift concerts, wedding announcements, random internet noise that doesn't drive intelligence and may actually slow training. The Muon optimizer strips down training to relevant data, cutting the computation needed for the same intelligence level. KIMI K3 proves this works at scale, and we're nowhere near done squeezing it.

Similar podbits