20VC: Are OpenAI and Anthropic Overvalued? The Open-Source AI Reality | How Token Costs Will Fall 10x And Usage Will Explode 100x | The Future Is Not One AGI; It's Millions of Specialised Models with Lin Qiao, Founder and CEO @ Fireworks

20VC: Are OpenAI and Anthropic Overvalued? The Open-Source AI Reality | How Token Costs Will Fall 10x And Usage Will Explode 100x | The Future Is Not One AGI; It's Millions of Specialised Models with Lin Qiao, Founder and CEO @ Fireworks

Fireworks AI hit $1B ARR with 200 people by betting that millions of specialised AI models will beat one AGI — and Lin Qiao says token costs will fall 10x while usage explodes 100x in three years.

Jul 20, 2026 1:17:07 Difficulty: Intermediate Played

TL;DR

Lin Qiao, founder and CEO of Fireworks AI, makes the case that the future of AI isn't one AGI ruling everything — it's millions of specialised models, one per application. Fireworks has hit $1B in ARR with just 200 people and processes over 40 trillion tokens a day, the vast majority from customised rather than off-the-shelf models. Lin predicts a 10x reduction in token costs over three years will unlock 100x more usage, and argues every company will eventually own its own intelligence stack the same way every company owns its own software stack. The single most useful takeaway: don't wait for AGI to solve your problem — own your model now or risk losing competitive differentiation.

#AI inference #specialised intelligence #open-weight models #token economics #enterprise AI #AGI debate #model customisation #reinforcement learning #AI sovereignty #GPU infrastructure #data centre economics #hypergrowth startups #AI co-work #AI safety and ownership #Fireworks AI #specialised models #open source AI #token costs #AGI #PyTorch #Cursor #model tuning #Lin Qiao #AI economics

Lin Qiao, Co-Founder and CEO of Fireworks AI, discusses why the company bet on inference over training, the open-source AI revolution, enterprise trust in Chinese models, the multi-model future, token cost trajectories, and whether Fireworks will eventually need to build its own data centres.

Chapter list
  • The episode opens with a punchy teaser from Lin Qiao before Harry Stebbings delivers a rare investor endorsement: a $10 million check written after just a 15-minute meeting. Harry breaks down the five reasons — a world-class team, a fast-growing inference market, triple-digit ARR growth to $1 billion in four years, the ability to hire stars like ex-Salesforce President George Hu, and the sheer upside potential of a company he thinks could reach $500 billion. The framing sets the episode's bullish tone before three sponsor integrations (JPMorgan, Navan, Base44) round out the opening block.

  • Harry asks the valuation question directly: if 90% of enterprise workflows can now be handled by open-weight models at a fraction of the cost, are Anthropic and OpenAI dramatically overvalued? Lin agrees the market is beginning to realise this, then introduces a more uncomfortable concept — 'scaling to bankruptcy.' In the SaaS era, finding product-market fit was the hard problem; scaling was cheap. In the AI era, these are decoupled. Companies with genuine customer demand and willingness to pay can destroy themselves by growing because the AI infrastructure COGS spiral faster than revenue. This creates a structural pull toward open-weight models that companies can control, customise, and optimise.

  • Harry — declaring a conflict of interest as a Lagoora investor — uses the Harvey-Lagoora dynamic as a test case. A year ago, not building your own model seemed fine because frontier models were improving so fast. Now the picture is reversed. Lin reframes the question: in legal, where error tolerance is near-zero and workflows are deeply specialised, the competitive advantage isn't whether you own a model but whether you've encoded your proprietary knowledge into the orchestration layer and the fine-tuned models that power it. He points to Cursor as evidence — they were the first coding AI company to tune their own models, and almost all coding companies have followed.

  • Harry asks whether the relentless pace of model launches is sustainable. Lin separates two layers: base general IQ advancement, which comes in occasional large step functions (like the introduction of chain-of-thought reasoning in early 2024), and specialisation, which builds rapidly on top of each step function. As base model quality improves, the number of specialised branches that can be grafted onto the trunk multiplies. If anything, Lin expects the specialisation wave to accelerate faster than general intelligence progress — a view with direct implications for Fireworks' market opportunity.

  • One of the most technically rich chapters in the episode. Lin explains that early AI tech adopters are hackers who want control, and Cursor — flush with frontier lab researchers — is the prime example. The problem they solved together is profound: hyperscalers run RL training on 100,000 interconnected chips. Cursor and Fireworks had no such cluster. Their solution was to decouple the trainer (which updates model weights) from the RL rollout (which deploys the model into a synthetic environment to collect rewards), distributing the system across five or six global data centre regions and syncing fresh model weights efficiently enough that the reward signal stays numerically sound. This distributed design enabled Cursor's recent model launches without a hyperscaler-level budget.

  • Harry opens with the customer concentration question — can Fireworks survive a Cursor churn given a potential SpaceX acquisition? Lin pivots to the broader portfolio: 2024 was the year of coding, 2025 is the year of co-work, and co-work customers span legal, finance, healthcare, consumer-facing recommendation systems, and beyond. He then drops a striking operational disclosure: Fireworks processes more than 40 trillion tokens per day, the majority from customised models. When Harry asks where that number goes in a year, Lin offers a range of 20x to 100x — and argues that at those growth rates, the idea that AI CapEx is in a bubble is simply wrong. The world is bottlenecked by physical supply chains, not by lack of demand.

  • This is the most quotable chapter in the episode. Lin explains that current token prices are artificially elevated by supply chain constraints, not by any fundamental cost floor. As competition increases and infrastructure scales, prices will fall sharply. He quantifies three levers: solving tasks requires fewer tokens as models become more precise; Fireworks' platform optimises inference unit economics for each customised workload; and underlying GPU and memory infrastructure will improve structurally over two to three years. The combined effect: a 10x cost reduction over three years that unlocks a 100x usage explosion. He then dives into zero KLD — Fireworks' commitment to bit-exact numerical equivalence from training to inference — as the quality guarantee that justifies its premium over commoditised inference providers.

  • Harry observes that China's lack of regulatory friction means data centres go up in weeks versus years in the US, and asks whether that translates into a structural AI advantage. Lin acknowledges the construction velocity differential but argues the US has comparable specialisation — the bottleneck is global supply chain constraints (electricians, transistors, materials) rather than policy alone. The conversation then broadens to sovereign models: the brief TikTok ban illustrated the existential vulnerability of depending on foreign-controlled infrastructure. Lin's analogy is stark — if your country's AI is like electricity, another country should never control the switch. The principle applies equally to individual enterprises: owning your intelligence is not optional.

  • The quickfire round delivers some of the episode's most memorable moments. Lin admits he was wrong to fear growing too fast — aggressive AI tool adoption and a refined hiring filter for extreme ownership changed his calculus. His Jensen Huang insight crystallises into a philosophy: replying to emails in one minute isn't ego, it's the only way to maintain the information freshness needed for precise, fast leadership judgement. His biggest regret is underinvesting in marketing early, framing it not as fluff but as the discipline of educating customers on the right direction. He closes with his sharpest three-year prediction: owning your own intelligence stack will become mandatory for every company, just as owning your own software stack is today. Sponsor reads for JPMorgan, Navan, and Base44 close the episode.

Inference
The process of running a trained AI model to generate outputs (answers, completions, etc.); distinct from training, which is when the model learns from data.
KL Divergence (KLD)
Kullback-Leibler Divergence — a statistical measure of how much two probability distributions differ; in AI, used to measure quality loss when a model moves between systems. 'Zero KLD' means no quality is lost.
RL Rollout
In reinforcement learning, the process of deploying a model version into an environment to collect reward signals that tell the trainer whether the model improved.
HBM (High Bandwidth Memory)
A high-speed RAM chip architecture used in AI accelerators; a critical and often scarce component in AI hardware supply chains.
ASIC (Application-Specific Integrated Circuit)
A chip designed for one specific type of computation rather than general-purpose use; companies like Groq build ASICs optimised for AI inference.
ARR (Annual Recurring Revenue)
A SaaS and subscription-business metric representing the annualised value of recurring revenue; used as a proxy for business scale and growth velocity.
SRAM (Static Random-Access Memory)
A type of fast, expensive memory used on-chip in AI accelerators; particularly suited to generative AI inference because it eliminates slow off-chip memory access.
Prefill
The first phase of LLM processing where the model reads and processes the input prompt; computationally distinct from the token generation (decoding) phase.
Zero KLD
Fireworks AI's internal quality standard requiring bit-exact numerical equivalence between the training system and the inference system, ensuring no accuracy is lost when a model is deployed.
Post-training
Techniques applied to a base model after initial training, such as reinforcement learning from human feedback (RLHF) or fine-tuning, to align or specialise the model.
Weight synchronisation
The process of copying updated model parameters (weights) from a trainer to inference workers across a distributed system; latency here affects how 'fresh' and accurate the rewards are.
S-curve
An adoption or growth pattern characterised by slow early growth, rapid acceleration, and eventual plateau; used here to describe AI token usage being in the early fast-growth phase.
COGS (Cost of Goods Sold)
The direct costs attributable to producing goods or services; for SaaS, this is infrastructure cost and directly determines gross margin.
Hill climbing
An iterative optimisation process where each step moves toward a better solution based on immediate feedback; used here to describe model fine-tuning towards a company-specific eval benchmark.
AGI (Artificial General Intelligence)
A hypothetical AI system capable of performing any intellectual task that a human can; the stated goal of labs like OpenAI and Anthropic and the concept Lin Qiao challenges.
InfiniBand
A high-speed networking standard used to interconnect GPUs in large training clusters; essential for hyperscaler-scale training runs but expensive and scarce.
Tape-out
The final stage of chip design when the design is sent to the fabrication plant for manufacturing; extremely expensive and difficult to reverse once committed.
Ubiquitously
Seemingly present everywhere simultaneously; used by Lin Qiao to describe a future where large AI models are accessible and affordable enough to run routinely across all applications.
Serendipity
The occurrence of fortunate events by chance; used by Lin Qiao to describe ASIC companies whose chip designs, developed before GenAI, happened to suit AI workloads perfectly.

Chapter 1 · 00:07

Why Did Fireworks Bet on Inference When Everyone Else Was Chasing Training?

The episode opens with a punchy teaser from Lin Qiao before Harry Stebbings delivers a rare investor endorsement: a $10 million check written after just a 15-minute meeting. Harry breaks down the five reasons — a world-class team, a fast-growing inference market, triple-digit ARR growth to $1 billion in four years, the ability to hire stars like ex-Salesforce President George Hu, and the sheer upside potential of a company he thinks could reach $500 billion. The framing sets the episode's bullish tone before three sponsor integrations (JPMorgan, Navan, Base44) round out the opening block.

Chapter 2 · 13:00

Can Open-Source Models Turn AI Infrastructure into a Commodity?

Harry asks the valuation question directly: if 90% of enterprise workflows can now be handled by open-weight models at a fraction of the cost, are Anthropic and OpenAI dramatically overvalued? Lin agrees the market is beginning to realise this, then introduces a more uncomfortable concept — 'scaling to bankruptcy.' In the SaaS era, finding product-market fit was the hard problem; scaling was cheap. In the AI era, these are decoupled. Companies with genuine customer demand and willingness to pay can destroy themselves by growing because the AI infrastructure COGS spiral faster than revenue. This creates a structural pull toward open-weight models that companies can control, customise, and optimise.

Chapter 3 · 19:00

Should Enterprises Trust Chinese Open Models With Their Most Sensitive Data?

Harry — declaring a conflict of interest as a Lagoora investor — uses the Harvey-Lagoora dynamic as a test case. A year ago, not building your own model seemed fine because frontier models were improving so fast. Now the picture is reversed. Lin reframes the question: in legal, where error tolerance is near-zero and workflows are deeply specialised, the competitive advantage isn't whether you own a model but whether you've encoded your proprietary knowledge into the orchestration layer and the fine-tuned models that power it. He points to Cursor as evidence — they were the first coding AI company to tune their own models, and almost all coding companies have followed.

Chapter 5 · 28:00

Will the Multi-Model World Create a $100BN Routing Layer?

One of the most technically rich chapters in the episode. Lin explains that early AI tech adopters are hackers who want control, and Cursor — flush with frontier lab researchers — is the prime example. The problem they solved together is profound: hyperscalers run RL training on 100,000 interconnected chips. Cursor and Fireworks had no such cluster. Their solution was to decouple the trainer (which updates model weights) from the RL rollout (which deploys the model into a synthetic environment to collect rewards), distributing the system across five or six global data centre regions and syncing fresh model weights efficiently enough that the reward signal stays numerically sound. This distributed design enabled Cursor's recent model launches without a hyperscaler-level budget.

Technology
Cursor's RL Training System Built with Fireworks

20VC: Are OpenAI and Anthropic Overvalued? The Open-Source … · Jul 20, 2026 Technology

Fireworks CTO Dima embedded at Cursor for months to build a distributed reinforcement learning infrastructure that decouples the trainer from RL rollout across six global data centre regions. This let a capital-constrained startup run training jobs that previously required 100,000 interconnected chips at a hyperscaler.

Chapter 6 · 37:00

How Much Will AI Token Usage Explode Over the Next Two Years?

Harry opens with the customer concentration question — can Fireworks survive a Cursor churn given a potential SpaceX acquisition? Lin pivots to the broader portfolio: 2024 was the year of coding, 2025 is the year of co-work, and co-work customers span legal, finance, healthcare, consumer-facing recommendation systems, and beyond. He then drops a striking operational disclosure: Fireworks processes more than 40 trillion tokens per day, the majority from customised models. When Harry asks where that number goes in a year, Lin offers a range of 20x to 100x — and argues that at those growth rates, the idea that AI CapEx is in a bubble is simply wrong. The world is bottlenecked by physical supply chains, not by lack of demand.

Chapter 7 · 43:00

Will Token Costs Fall 10x—and Unleash 100x More Demand?

This is the most quotable chapter in the episode. Lin explains that current token prices are artificially elevated by supply chain constraints, not by any fundamental cost floor. As competition increases and infrastructure scales, prices will fall sharply. He quantifies three levers: solving tasks requires fewer tokens as models become more precise; Fireworks' platform optimises inference unit economics for each customised workload; and underlying GPU and memory infrastructure will improve structurally over two to three years. The combined effect: a 10x cost reduction over three years that unlocks a 100x usage explosion. He then dives into zero KLD — Fireworks' commitment to bit-exact numerical equivalence from training to inference — as the quality guarantee that justifies its premium over commoditised inference providers.

Chapter 8 · 49:00

Does Fireworks Eventually Have to Build Its Own Data Centres?

Harry observes that China's lack of regulatory friction means data centres go up in weeks versus years in the US, and asks whether that translates into a structural AI advantage. Lin acknowledges the construction velocity differential but argues the US has comparable specialisation — the bottleneck is global supply chain constraints (electricians, transistors, materials) rather than policy alone. The conversation then broadens to sovereign models: the brief TikTok ban illustrated the existential vulnerability of depending on foreign-controlled infrastructure. Lin's analogy is stark — if your country's AI is like electricity, another country should never control the switch. The principle applies equally to individual enterprises: owning your intelligence is not optional.

Chapter 9 · 1:00:15

What Is the Real Bottleneck Holding Back the AI Economy?

The quickfire round delivers some of the episode's most memorable moments. Lin admits he was wrong to fear growing too fast — aggressive AI tool adoption and a refined hiring filter for extreme ownership changed his calculus. His Jensen Huang insight crystallises into a philosophy: replying to emails in one minute isn't ego, it's the only way to maintain the information freshness needed for precise, fast leadership judgement. His biggest regret is underinvesting in marketing early, framing it not as fluff but as the discipline of educating customers on the right direction. He closes with his sharpest three-year prediction: owning your own intelligence stack will become mandatory for every company, just as owning your own software stack is today. Sponsor reads for JPMorgan, Navan, and Base44 close the episode.

Technology
The Greatest Bottleneck: No System for 10 Trillion Parameter Models

20VC: Are OpenAI and Anthropic Overvalued? The Open-Source … · Jul 20, 2026 Technology

Everyone talks about HBM or energy as the AI bottleneck. Lin Qiao's answer is different: the industry still has no great system designed for 10-trillion-parameter models. Closing that gap requires co-design from model to serving platform to chip system — a level of integration that doesn't yet exist.

Business
George Hu: The President of Salesforce Joins Fireworks at 200 People

20VC: Are OpenAI and Anthropic Overvalued? The Open-Source … · Jul 20, 2026 Business

Lin Qiao met George Hu, the former President of Salesforce, a year before hiring him — and turned him down because Fireworks had only 50 people. The relationship evolved through board-level advice before Hu formally joined as Fireworks crossed into hypergrowth. The lesson: build the relationship early, even if the timing isn't right yet.

No indexed bits in this chapter.

Show stoppers

Snapshots ()

Key Quotes ()

This episode

Claims & Sources

0 / 15 cited (0%)

Factual claims made this episode, and whether a source was named.

Fireworks AI has scaled to $1 billion in ARR in approximately 4 years.

Harry Stebbings no source cited

Fireworks AI processes more than 40 trillion tokens per day, with the majority coming from customised rather than off-the-shelf models.

Lin Qiao no source cited

AI token costs will fall 10x over the next 3 years, and this cost reduction will drive a 100x increase in usage.

Lin Qiao no source cited

Cursor grew approximately 1,000x in revenue over two years, starting from single-digit millions when it first partnered with Fireworks AI.

Lin Qiao no source cited

Marc Benioff spends approximately 3.8% of Salesforce developer salaries on Anthropic's Claude Code.

Harry Stebbings no source cited

The top 6 open-source AI models globally are currently Chinese-built.

Harry Stebbings no source cited

Fireworks AI raised $1.5 billion at a $17 billion valuation.

Harry Stebbings no source cited

Fireworks AI expects to at least double its ARR by the end of 2026.

Lin Qiao no source cited

The industry average time to book a business trip is 45 minutes, versus 7 minutes on Navan's platform.

Harry Stebbings no source cited

Fireworks AI was founded when Lin Qiao was 48 years old, after 7 years at Meta.

Harry Stebbings no source cited

Meta's MTIA custom AI chip programme has been running since at least 2018, long before the generative AI era.

Lin Qiao no source cited

Traditional GPU hardware used to be depreciated over 6-year cycles; now multiple new GPU SKUs from NVIDIA launch within a single year.

Lin Qiao no source cited

Fireworks AI achieves zero KL-divergence (zero KLD) between training and inference, meaning model weights transfer with bit-exact numerical equivalence.

Lin Qiao no source cited

Fireworks AI's distributed RL training system for Cursor runs across 5 to 6 global data centre regions, tapping into scattered GPUs.

Lin Qiao no source cited

Fireworks AI had approximately 50 employees a year before the episode was recorded, and now has approximately 200.

Lin Qiao no source cited

This episode

Cast

  • Track
  • Track
  • Track

Stats

Episode stats

Insight Overview

insights
chapters

Insight distribution

Sub-Categories

Speaker breakdown

Talk Time

No links parsed

We scan show notes for social handles, websites and apps. Nothing matched on this episode.