The a16z Show

Snapshot · The a16z Show

The Self-Improving Company | Kavak's AI Playbook

Explore episode Aug 10, 2026

Where this was said

Evals: The Brakes That Let You Go Fast

At 8:15 · chapter starts 8:10

Gabriel asks how Kavak evaluates whether agents are working at the scale of 96–98% of all interactions. Alejandro's answer reframes the question entirely: evals are not a safety tax, they are the accelerator. His analogy is elegant — you'll only floor the gas if you have good brakes. Most companies go slow on AI deployment because they lack rigorous evaluation, not because the models are weak. Kavak inverts this by spending roughly equal engineering time, tokens, and money on building evals as on building agents themselves. The measurement focus is ruthlessly commercial: did the customer convert? Did they come back? Not vanity metrics like call duration or number of interactions. This discipline, Alejandro argues, is what separates genuine agentic deployment from theatre.

Similar snapshots