Snapshot · The MongoDB Podcast
Querying the same LLM model 10 times with the identical question provides no guarantee of receiving the same response each time, making traditional testing approaches obsolete.
Where this was said
At 2:05 · chapter starts 1:55
Karthik strips away the jargon to explain Langtrace in the simplest possible terms: it shows developers what's happening inside their AI stack. The core problem it solves is the non-deterministic nature of LLMs — query a model ten times with the same question and there is no guarantee of a consistent answer. Langtrace instruments both the inputs going into a model and the outputs coming back, giving developers a concrete window into behavior they would otherwise be guessing at. Built on OpenTelemetry standards, the platform has two components: an SDK (supporting Python and TypeScript) that patches libraries at runtime, and a dashboard for visualizing traces. Because it follows open standards, developers can also route traces to any compatible observability vendor they already use, making adoption low-friction.
Langtrace wasn't designed to monitor LLMs — it was built to fix hallucinating chatbot features inside a blockchain observability product. When users reported the AI features were giving wrong answers, the team had zero visibility into what was going wrong, so they duct-taped an OpenTelemetry SDK together internally. That internal tool became Langtrace.
Sam's initial MVP was coded in approximately one week using ChatGPT voice mode and copy-pasting code, with no prior technical experience.
Sam argues Discord is 10x better than email for building relationships with younger users who rarely check their inbox.
Sam's monthly operating costs include Cursor ($200), AI image generation ($100), AI video generation ($200), hosting ($100), email marketing ($80), and AI compute ($300–$500).
Sam recommends copying days of Discord chat history into ChatGPT and prompting it to list recurring pain points as a fast, free market research technique.
Bhanu and his team built approximately 50 free tools to attract search traffic, each linked back to SiteGPT.
With AI coding tools like Cursor, Bhanu can now create a new free marketing tool in less than 5 minutes by referencing existing tools.
Bhanu filters Ahrefs keyword results to show only those with a keyword difficulty below 10, making them realistic ranking targets for any decent website.
Bhanu sets a minimum search volume of 1,000 monthly searches when selecting keywords to target with free tools.
PropGPT averaged 20 downloads per day right after launching on the App Store through influencer marketing.
We use essential and analytics cookies to run Vuci. To understand how the site is used: Privacy Policy.
Install Vuci on your phone
Add it to your home screen for a faster, app-like experience.
Install Vuci on your phone
Tap the Share button, then “Add to Home Screen”.
A new version is available
Reload to get the latest Vuci.