Data industry: billions → soon deca-billions
The industry producing expert labels and RL training environments is already earning billions per year in revenue, soon to be tens of billions.
Where this was said
What is really driving AI progress?
At 1:15 · chapter starts 0:00
Dwarkesh argues that AI's main progress driver is data volume and quality, not algorithmic breakthroughs. RL is framed as synthetic data generation. Expert data labeling is described as a billion-dollar industry. [1] — Dwarkesh Patel "AI capabilities look like a galaxy of stars, but at the center is an invisible black hole of data. The main way AIs have gotten better is n…"
The Data Black Hole: AI's Real Secret
AI capabilities look like a galaxy of stars, but at the center is an invisible black hole of data. The main way AIs have gotten better is not through better architectures or training tricks — it's by adding more and better data and scaling compute to generate it.
AI Models Are Frankenstein's Monster
AI models aren't learning the way humans do. They're more like Frankenstein's monster — stitched together from a billion carefully constructed example graphs. That's the uncomfortable truth behind what looks like fluid, general intelligence.
GRPO: hundreds–thousands of rollouts per task
With GRPO, AI models generate hundreds to thousands of rollouts per task to solve the credit assignment problem, far more than the one or two times a human student might practice a problem.
Why Open Source Can Always Catch Up
Open models trail frontier models by only 4 months. The reason is that data — the actual driver of progress — can be distilled from public APIs. Hyperparameters and training tricks can't be. If architecture were the real edge, the gap would be far larger.
Open models lag frontier by 4 months
Epoch AI reported that open models lag state-of-the-art frontier models by only 4 months, which Dwarkesh attributes to data being the real driver — easily distilled from public APIs.
Similar snapshots
$25K/month revenue
Avnish's solopreneur business reached $25,000 per month in revenue using a community-driven, zero-ad-spend marketing strategy.
15 months to $25K/month
Avnish scaled his business from zero to $25K/month in just 15 months using a single core marketing strategy.
Zero marketing spend
Avnish acquired thousands of users without spending any money on marketing, relying entirely on Reddit and Facebook groups.
Single thousands to tens of thousands of users
One specific Reddit or Facebook post was responsible for taking Avnish's user base from single thousands to tens of thousands.
5-step playbook
Avnish developed a 5-step process specifically for finding early users through Facebook groups and Reddit communities.
80% of time above the fold
Focus 80% of your landing page design effort on the hero section — the first thing visitors see when they open the website.
Hero section carries full message
The hero section must convey the product's complete value proposition on its own, so visitors instantly understand what it is.
First couple of seconds matter most
Visitors decide whether to stay or leave within just a few seconds, so immediate clarity is essential on any landing page.
Pain-point headline drives conversion
Highlighting time savings, money savings, or a painful problem solved in the headline and subheading is the core conversion lever.
