Quote · The a16z Show
Hugging Face's CEO on Open Source AI, Model Routing, and the Future of Competition
Where this was said
Open Source Safety: Sunlight, Nuclear Bombs, and Structural Differences
At 7:10 · chapter starts 6:50
This chapter is the intellectual heart of Clément Delangue's argument about open source and safety. He invokes the principle that 'sunlight is the best disinfectant' and points out that no major dangerous technology in history — starting with the nuclear bomb — was developed in the open. Nuclear weapons required a closed, proprietary Manhattan Project with billions in resources, not a public GitHub repo. He extrapolates: AI cybersecurity capabilities capable of causing real harm are unlikely to emerge from the open-source community, not because it lacks talent but because it lacks the structural incentives and resources to pursue them. He also challenges the assumption that 'more powerful = more dangerous,' arguing that a model could be more powerful for medicine or climate science without becoming more dangerous for cyberattacks — especially if it wasn't trained on cybersecurity data. The 'jagged frontier' concept closes the chapter: different models lead on different tasks, and treating 'the frontier' as a single uniform bar misrepresents how AI capability actually works.
Clément Delangue argued that the most dangerous technologies — like the nuclear bomb — were never developed in open source but in closed, well-funded proprietary environments.
