The Transformer paper was published around 2016–2017, and it still took approximately 5 years until the ChatGPT moment in late 2022.
Snapshot · Huberman Lab
The Transformer paper was published around 2016–2017, and it still took approximately 5 years until the ChatGPT moment in late 2022.
Where this was said
At 23:05 · chapter starts 21:19
Andrew Huberman raises the question of whether the data-plus-algorithm recipe that worked for vision was similarly applied to sound and speech recognition. Fei-Fei Li confirms that ImageNet's success did indeed open the floodgates: every sub-area of AI — speech recognition, sound classification, natural language processing — received a significant boost. She offers the charming example of Stanford colleagues using machine learning to analyze whale songs. But the more transformative moment, she argues, came with the Transformer architecture around 2016–2017, which proved dramatically more powerful than the ImageNet-era AlexNet and was ideally suited for the vast abundance of text available on the internet. Companies like OpenAI and Google quickly rallied around this architecture, though it still took approximately five years from the paper's publication to the ChatGPT moment in late 2022.
Sam's initial MVP was coded in approximately one week using ChatGPT voice mode and copy-pasting code, with no prior technical experience.
Sam argues Discord is 10x better than email for building relationships with younger users who rarely check their inbox.
Sam's monthly operating costs include Cursor ($200), AI image generation ($100), AI video generation ($200), hosting ($100), email marketing ($80), and AI compute ($300–$500).
Sam recommends copying days of Discord chat history into ChatGPT and prompting it to list recurring pain points as a fast, free market research technique.
Bhanu and his team built approximately 50 free tools to attract search traffic, each linked back to SiteGPT.
With AI coding tools like Cursor, Bhanu can now create a new free marketing tool in less than 5 minutes by referencing existing tools.
Bhanu filters Ahrefs keyword results to show only those with a keyword difficulty below 10, making them realistic ranking targets for any decent website.
Bhanu sets a minimum search volume of 1,000 monthly searches when selecting keywords to target with free tools.
PropGPT averaged 20 downloads per day right after launching on the App Store through influencer marketing.
We use essential and analytics cookies to run Vuci. To understand how the site is used: Privacy Policy.
Install Vuci on your phone
Add it to your home screen for a faster, app-like experience.
Install Vuci on your phone
Tap the Share button, then “Add to Home Screen”.
A new version is available
Reload to get the latest Vuci.