Data industry: billions → soon deca-billions
The industry producing expert labels and RL training environments is already earning billions per year in revenue, soon to be tens of billions.
Where this was said
What is really driving AI progress?
At 1:15 · chapter starts 0:00
Dwarkesh argues that AI's main progress driver is data volume and quality, not algorithmic breakthroughs. RL is framed as synthetic data generation. Expert data labeling is described as a billion-dollar industry. [1] — Dwarkesh Patel "AI capabilities look like a galaxy of stars, but at the center is an invisible black hole of data. The main way AIs have gotten better is n…"
The Data Black Hole: AI's Real Secret
AI capabilities look like a galaxy of stars, but at the center is an invisible black hole of data. The main way AIs have gotten better is not through better architectures or training tricks — it's by adding more and better data and scaling compute to generate it.
AI Models Are Frankenstein's Monster
AI models aren't learning the way humans do. They're more like Frankenstein's monster — stitched together from a billion carefully constructed example graphs. That's the uncomfortable truth behind what looks like fluid, general intelligence.
GRPO: hundreds–thousands of rollouts per task
With GRPO, AI models generate hundreds to thousands of rollouts per task to solve the credit assignment problem, far more than the one or two times a human student might practice a problem.
Why Open Source Can Always Catch Up
Open models trail frontier models by only 4 months. The reason is that data — the actual driver of progress — can be distilled from public APIs. Hyperparameters and training tricks can't be. If architecture were the real edge, the gap would be far larger.
Open models lag frontier by 4 months
Epoch AI reported that open models lag state-of-the-art frontier models by only 4 months, which Dwarkesh attributes to data being the real driver — easily distilled from public APIs.
Similar snapshots
$14K/month in 6 months
Sam built Algrow from zero to $14,000 in monthly revenue within just six months of shipping his first MVP.
10,000 users in 6 months
Algrow reached over 10,000 users in roughly six months, driven almost entirely by organic Discord community growth.
First 400 users from Discord
Sam acquired his first 400 users entirely through Discord communities, without paid advertising or traditional outreach.
480 new customers in one month
Algrow added exactly 480 new paying customers in its most recent month, demonstrating strong ongoing growth.
£10K revenue in last 4 weeks
Sam's Stripe dashboard showed over £10,000 in revenue in the last four weeks, equivalent to roughly $13,000–$14,000 USD.
Free access for early users as growth hack
Sam gave all early users free access so they could show the tool to friends, turning them into live demos and advocates who helped the product spread virally.
No self-promo rule exploit: screen sharing
By silently screen-sharing his tool in Discord voice chats rather than posting links, Sam attracted curiosity without violating no-self-promo server rules.
$10K+ from affiliate marketing first
Before building Algrow, Sam and two friends made over $10,000 in revenue through affiliate marketing for RizzApp by posting faceless texting story content.
$13K MRR with $0 marketing spend
Bhanu grew SiteGPT to $13,000 monthly recurring revenue entirely through organic channels, spending nothing on paid marketing.
