Quote · Modern Wisdom
Why The AI Doomers Might Be Right - Robert Wright - #1122
Where this was said
The Moral Upgrade: Why AI Requires a More Enlightened Humanity
At 28:00 · chapter starts 23:03
Wright develops his central prescription for the AI era: the primary thing humanity needs is not more intelligence or better technology, but a species-wide improvement in cognitive empathy — the ability to understand how others see the world, without necessarily feeling their emotions or sharing their values. He is careful to distinguish this from full-on benevolence or emotional empathy, drawing on a well-established psychological distinction: you do not have to care about or like someone to understand what they want and why. And in non-zero-sum relationships — where both parties can win or lose together — that understanding is sufficient for productive cooperation. Wright grounds this in his earlier book Nonzero, which argued roughly 26 years ago that technological progress was making relations among nations ever more non-zero-sum; AI intensifies this dynamic dramatically. He uses the intuitive example of calming down before replying to an annoying email: the physiological settling-down isn't just tactically smarter, it genuinely improves your ability to understand the other person's perspective. That same mechanism, applied globally, is what Wright argues humanity needs to develop.
Formal arms control agreements aren't enough for AI governance — AI is simply too complex to monitor via treaties alone. The deeper solution is organic transparency: scientists sharing drinks after conferences, business people building cross-border relationships, the informal intelligence that flows from genuine engagement.
Robert Wright wrote a book called Nonzero about growing non-zero-sum dynamics among nations roughly 26 years ago — its thesis about international interdependence now applies directly to AI governance.
