Epoch AI reported that open models lag state-of-the-art frontier models by only 4 months, which Dwarkesh attributes to data being the real driver — easily distilled from public APIs.
Where this was said
At 2:36 · chapter starts 0:00
Dwarkesh argues that AI's main progress driver is data volume and quality, not algorithmic breakthroughs. RL is framed as synthetic data generation. Expert data labeling is described as a billion-dollar industry. [1] — Dwarkesh Patel "AI capabilities look like a galaxy of stars, but at the center is an invisible black hole of data. The main way AIs have gotten better is n…"
AI capabilities look like a galaxy of stars, but at the center is an invisible black hole of data. The main way AIs have gotten better is not through better architectures or training tricks — it's by adding more and better data and scaling compute to generate it.
The industry producing expert labels and RL training environments is already earning billions per year in revenue, soon to be tens of billions.
AI models aren't learning the way humans do. They're more like Frankenstein's monster — stitched together from a billion carefully constructed example graphs. That's the uncomfortable truth behind what looks like fluid, general intelligence.
With GRPO, AI models generate hundreds to thousands of rollouts per task to solve the credit assignment problem, far more than the one or two times a human student might practice a problem.
Open models trail frontier models by only 4 months. The reason is that data — the actual driver of progress — can be distilled from public APIs. Hyperparameters and training tricks can't be. If architecture were the real edge, the gap would be far larger.
Sam's initial MVP was coded in approximately one week using ChatGPT voice mode and copy-pasting code, with no prior technical experience.
Sam argues Discord is 10x better than email for building relationships with younger users who rarely check their inbox.
Sam's monthly operating costs include Cursor ($200), AI image generation ($100), AI video generation ($200), hosting ($100), email marketing ($80), and AI compute ($300–$500).
Sam recommends copying days of Discord chat history into ChatGPT and prompting it to list recurring pain points as a fast, free market research technique.
Bhanu and his team built approximately 50 free tools to attract search traffic, each linked back to SiteGPT.
With AI coding tools like Cursor, Bhanu can now create a new free marketing tool in less than 5 minutes by referencing existing tools.
Bhanu filters Ahrefs keyword results to show only those with a keyword difficulty below 10, making them realistic ranking targets for any decent website.
Bhanu sets a minimum search volume of 1,000 monthly searches when selecting keywords to target with free tools.
PropGPT averaged 20 downloads per day right after launching on the App Store through influencer marketing.
We use essential and analytics cookies to run Vuci. To understand how the site is used: Privacy Policy.
Install Vuci on your phone
Add it to your home screen for a faster, app-like experience.
Install Vuci on your phone
Tap the Share button, then “Add to Home Screen”.
A new version is available
Reload to get the latest Vuci.