Snapshot · The MongoDB Podcast
Despite 2 million token context windows existing, developers have repeatedly shown that over-stuffing an LLM's context window leads to increased hallucinations rather than better results.
Where this was said
At 44:20 · chapter starts 42:40
The forward-looking section reveals both the intellectual humility and the ambition behind Langtrace's roadmap. Karthik acknowledges that even the core question of how to architect AI agents — single reasoning model vs. planner-executor split — has no settled answer. Open problems like tool calls that return massive JSON payloads (too large for any context window to handle reliably, even at 2 million tokens) remain unsolved. [1] — Karthik Kalyanamaran "Right now, Langtrace surfaces all the data and leaves interpretation to the developer. The next frontier is the platform providing intellig…" 45:40 The direction Langtrace is pursuing is a shift from 'here is all the data' to 'here is what you should do about it' — intelligent, actionable suggestions that tell a developer whether to fix their prompt, improve context, or tune retrieval, without requiring them to diagnose the problem themselves. To stay grounded in real developer pain, the Langtrace team builds AI agents internally. One experiment became a product: Hey Zest, a Slack bot platform in closed beta that lets any team deploy AI agents — including one backed by MongoDB Atlas Vector Search for natural-language database queries — directly in their workspace. It emerged from the same dogfooding philosophy that created Langtrace.
Right now, Langtrace surfaces all the data and leaves interpretation to the developer. The next frontier is the platform providing intelligent suggestions — telling you whether to fix your prompt, improve your context, or tune your retrieval — without the developer having to figure it out themselves. Langtrace is also building AI agents internally to stay close to the real problems.
Every experienced AI builder Karthik knows has followed the same arc: start with a framework, hit its limits, and strip back to native model primitives. The lesson is to start there. Building directly on OpenAI's or another provider's raw API gives you the deepest understanding of what's actually happening — and that understanding is what lets you design a real architecture.
Sam's initial MVP was coded in approximately one week using ChatGPT voice mode and copy-pasting code, with no prior technical experience.
Sam argues Discord is 10x better than email for building relationships with younger users who rarely check their inbox.
Sam's monthly operating costs include Cursor ($200), AI image generation ($100), AI video generation ($200), hosting ($100), email marketing ($80), and AI compute ($300–$500).
Sam recommends copying days of Discord chat history into ChatGPT and prompting it to list recurring pain points as a fast, free market research technique.
Bhanu and his team built approximately 50 free tools to attract search traffic, each linked back to SiteGPT.
With AI coding tools like Cursor, Bhanu can now create a new free marketing tool in less than 5 minutes by referencing existing tools.
Bhanu filters Ahrefs keyword results to show only those with a keyword difficulty below 10, making them realistic ranking targets for any decent website.
Bhanu sets a minimum search volume of 1,000 monthly searches when selecting keywords to target with free tools.
PropGPT averaged 20 downloads per day right after launching on the App Store through influencer marketing.
We use essential and analytics cookies to run Vuci. To understand how the site is used: Privacy Policy.
Install Vuci on your phone
Add it to your home screen for a faster, app-like experience.
Install Vuci on your phone
Tap the Share button, then “Add to Home Screen”.
A new version is available
Reload to get the latest Vuci.