30–50% compute on inference
Labs spend 30 to 50% of their total compute on inference, yet this compute currently plays no productive role in improving the model.
Snapshot · Dwarkesh Podcast
The next big breakthrough will be AIs learning on the job
Explore episode
Jun 26, 2026
Where this was said
Will RLVR alone generalize?
At 8:08 · chapter starts 6:10
Dwarkesh questions whether RLVR generalizes from containerized tasks to complex real-world domains like politics or business, citing Dario Amodei's context-length degradation comment as a key data point [1] — Dwarkesh Patel "Dario Amodei noted that training at short context lengths and serving at long ones can cause performance degradation. Dwarkesh reads this a…" 06:55 .
Dario Amodei's Hint That RLVR Generalization Has Limits
Dario Amodei noted that training at short context lengths and serving at long ones can cause performance degradation. Dwarkesh reads this as evidence that RLVR generalization is not infinite — a crack in the foundation of the labs' AGI bet.
30–50% of Compute Is Wasted on Inference
Labs burn 30–50% of compute on inference — and currently gain zero improvement to the model from it. Meanwhile, deployment is where the most valuable learning signals actually exist: real organizational context, real mistakes, real feedback.
Similar snapshots
MVP built in one week
Sam's initial MVP was coded in approximately one week using ChatGPT voice mode and copy-pasting code, with no prior technical experience.
Discord vs email for young users
Sam argues Discord is 10x better than email for building relationships with younger users who rarely check their inbox.
Monthly infra costs ~$780–$980
Sam's monthly operating costs include Cursor ($200), AI image generation ($100), AI video generation ($200), hosting ($100), email marketing ($80), and AI compute ($300–$500).
ChatGPT-powered pain point research
Sam recommends copying days of Discord chat history into ChatGPT and prompting it to list recurring pain points as a fast, free market research technique.
50 free tools built total
Bhanu and his team built approximately 50 free tools to attract search traffic, each linked back to SiteGPT.
New tool built in under 5 minutes
With AI coding tools like Cursor, Bhanu can now create a new free marketing tool in less than 5 minutes by referencing existing tools.
KD filter < 10 for rankable keywords
Bhanu filters Ahrefs keyword results to show only those with a keyword difficulty below 10, making them realistic ranking targets for any decent website.
Minimum 1,000 monthly search volume
Bhanu sets a minimum search volume of 1,000 monthly searches when selecting keywords to target with free tools.
20 downloads/day at launch
PropGPT averaged 20 downloads per day right after launching on the App Store through influencer marketing.
