Philosopher Nick Bostrom says delaying superintelligence could mean delaying breakthroughs that radically extend human life:
"Eliezer Yudkowsky and Nate Soares had this book, 'If Anyone Builds It, Everyone Dies.' And it seemed to me that we have at least as strong evidence for the claim that if nobody builds it, everyone dies."
"Successfully developing safe superintelligence, I think could lead to enormous breakthroughs in biomedicine and in anti-aging interventions that could radically extend the lifespan of currently existing people."
"If you think about what our life expectancy would be if we weren't aging, it's something on the order of 1,200, maybe 1,400 years or so. And that maybe is a quite conservative lower bound because in this situation you might also have other ways of reducing other mortality risks like accidents and so forth."
"You might think that if we spend more time doing AI alignment research, the existential risk from developing AI goes down at some rate. And then on the other hand, every year that we delay it, we have millions and millions of people dying."
"You don't want to delay a single day longer than you really need to."
Nick Bostrom says delaying superintelligence carries risks of its own. Every year of delay could postpone medical breakthroughs that extend human life and reduce suffering.
Furthermore, AI's upside could extend far beyond longer lives and higher living standards, opening up new possibilities for human intelligence, emotional depth, creativity, and connection.
Nick joins a16z's Eddy Lazzarin and Elena Burger to discuss what people misunderstand about his views, what “deep utopia” means, and what human purpose might look like in a world with superintelligence.
00:00 Intro
00:56 What we've learned about AI
02:51 Misconceptions about Bostrom’s views
04:12 Why he wrote Deep Utopia
07:29 How humanity should navigate superintelligence
11:00 Aligning superintelligence
15:51 The cost of delaying superintelligence
23:09 Building superintelligence safely
27:10 AI research isn’t the Manhattan Project
30:27 Why our vision of the future matters now
32:49 Does life have a meaning, and can AI answer it?
YouTube: youtu.be/gDW9An30_c0
@eddylazzarin @VirtualElena
Korē retweeted
Same is true for inventors of motion picture cameras. Both Edison with his Kinetograph and the Lumière brothers in France made predictions on their use that were way off.
Edison: stage performances and opera singers.
Lumière brothers: unstaged, documentary views of ordinary life ("actualités").
Lesson in that.
Marc Andreessen explained why the people who invented AI are the worst people to ask about its future, using a mistake Thomas Edison made in 1877...
Geoffrey Hinton won a Nobel Prize in 2024 for the work behind modern AI.
When people ask Hinton where AI is going, he believes "rampant unemployment" and UBI for everybody.
"People think, because he's one of the inventors of AI, that he must be the guy who knows."
Andreessen's answer is Thomas Edison.
Edison invented the phonograph in 1877. To him, Andreessen says, the use was obvious. Every family would buy a record player and a library of discs with sermons from the great preachers of the time. Then the machine went on sale.
"Immediately, of course, it's music. It's ragtime, and swing, then it's jazz. And Edison's just completely horrified."
"If Edison didn't know what the phonograph was going to get used for, the idea that Joe AI entrepreneur is going to be able to forecast the economic implications... No. That's not going to happen."
Inventors, he says, are "too buried in the specifics of the here and now."
He includes himself.
"I don't know if there's anybody that can predict big cultural, or economic or social trends, but it's certainly not somebody who's been in the lab for 20 years, including myself."
Korē retweeted
The circumstances don't matter: If you're trying to place blame, you're not serious about solving the problem.
Korē retweeted
W̵̧̱̭̤̓͒͂͂ͨ̊̍͟͢H̴̴̑̇͆͂͂̓҉͙͉̻͖̤͢A̷̵̯̅̊̀̚T̵̬͕ͩ͆ͩ̔ͤ͌̏͠͠ I̵̢̲̺͍̖̪͒̓̃ͣ̆̎̽͂͜͝ͅS̷̠̪͑ͩ́ T̵̛͉̤̄ͫͩ͊̓̃͟͠H̱̻͈͂̉̑̕͢Ę̬͒̊̊͑̐̄ͥͪ͝ #̢͓̱ͥ̂ͣͦ̾ͩͬ̔͆M̛̦̿ͬͪ̌̀̀́A͔̜̅̈́̄̕T̴̞ͨ̔̂̐̎͟R̡̨̺͈̗̥̊͆̏́̕͘I̴̢̦̤̞ͬͨ͂͑ͭX̸̨̢̰̖͓̣͓̻̗̹͖͒͛̌
Korē retweeted
“If everyone lives roughly the same lies about the same thing, there is no one to call them liars. They jointly establish their own sanity and themselves normal.”
~Ernest Becker
Korē retweeted
Sitting still is for suckers, "You must always be jiggling a little bit, testing out which seems to be the easiest way." -Richard Feynman 'Surely You're Joking, Mr. Feynman!"
Always Be Jiggling
"You must always be jiggling a little bit, testing out which seems to be the easiest way." -Richard Feynman 'Surely You're Joking, Mr. Feynman!"
"When I use a word," Humpty Dumpty said in a scornful tone, "it means just what I choose it to mean—neither more nor less."
"The question is," said Alice, "whether you can make words mean so many different things."
"The question is," said HD, "which is to be master—that's all."
Two thoughts from Alfred Korzybski
“Who rules our symbols, rules us.”
"The map is not the territory."
1
23
Korē retweeted
Two thoughts from Alfred Korzybski
“Who rules our symbols, rules us.”
"The map is not the territory."
















