Syntax - Tasty Web Development Treats

Podbit · Syntax - Tasty Web Development Treats

1019: LGTM, Ship It: The AI Code Review Problem

Explore episode Jul 8, 2026

Where this was said

What the heck are local models?

At 13:50 · chapter starts 11:21

A question from Sarah Chen asks for an explainer on local models. The answer seems simple — local means the model weights run on your machine — but the hosts note with some exasperation that the term is widely misunderstood. Developers using tools like OpenCode with DeepSeek think they're 'running locally' when they're actually sending every prompt to servers in China. Scott points to CJ's 'Your Guide to Local AI' video as the definitive resource and declines to recreate it. Wes broadens the picture: local models make enormous sense for purpose-built, narrow tasks — toxicity detection, face detection, speech-to-text, vectorization. Hugging Face hosts thousands of small models that run well in the browser via Transformers.js (Wes cites a prior podcast guest, Zinova, as context). But running a general-purpose frontier-quality model locally is a compute nightmare most people are completely unprepared for. The episode's most darkly comedic moment arrives here: Wes describes an Instagram user on a TV-tray laptop who believes he is building 'Fable' (a hypothetical frontier AI) from scratch. Claude is gamely generating encouraging graphs and telling the user he's a '0.1% advanced user.' The hosts land somewhere between laughter and genuine concern.

Similar podbits