The economy and national security after AGI | Carl Shulman
Вставка
- Опубліковано 3 лип 2024
- The human brain does what it does with a shockingly low energy supply: just 20 watts - a fraction of a cent worth of electricity per hour. What would happen if AI technology merely matched what evolution has already managed, and could accomplish the work of top human professionals given a 20-watt power supply?
Many people sort of consider that hypothetical, but maybe nobody has followed through and considered all the implications as much as Carl Shulman. Behind the scenes, his work has greatly influenced how leaders in artificial general intelligence (AGI) picture the world they're creating.
Learn more and find the full transcript on the 80,000 Hours website: 80000hours.org/podcast/episod...
Carl simply follows the logic to its natural conclusion. This is a world where 1 cent of electricity can be turned into medical advice, company management, or scientific research that would today cost $100s, resulting in a scramble to manufacture chips and apply them to the most lucrative forms of intellectual labour.
It's a world where, given their incredible hourly salaries, the supply of outstanding AI researchers quickly goes from 10,000 to 10 million or more, enormously accelerating progress in the field.
It's a world where companies operated entirely by AIs working together are much faster and more cost-effective than those that lean on humans for decision making, and the latter are progressively driven out of business.
It's a world where the technical challenges around control of robots are rapidly overcome, leading to robots into strong, fast, precise, and tireless workers able to accomplish any physical work the economy requires, and a rush to build billions of them and cash in.
As the economy grows, each person could effectively afford the practical equivalent of a team of hundreds of machine 'people' to help them with every aspect of their lives.
In today's episode, Carl explains the above, and host Rob Wiblin pushes back on whether it's realistic or just a cool story.
• Cold open [00:00:00]
• Rob’s intro [00:01:00]
• Transitioning to a world where AI systems do almost all the work [00:05:21]
• Economics after an AI explosion [00:14:25]
• Objection: Shouldn’t we be seeing economic growth rates increasing today? [00:59:12]
• Objection: Speed of doubling time [01:07:33]
• Objection: Declining returns to increases in intelligence? [01:11:59]
• Objection: Physical transformation of the environment [01:17:39]
• Objection: Should we expect an increased demand for safety and security? [01:29:14]
• Objection: “This sounds completely whack” [01:36:10]
• Income and wealth distribution [01:48:02]
• Economists and the intelligence explosion [02:13:31]
• Baumol effect arguments [02:19:12]
• Denying that robots can exist [02:27:18]
• Classic economic growth models [02:36:12]
• Robot nannies [02:48:27]
• Slow integration of decision-making and authority power [02:57:39]
• Economists’ mistaken heuristics [03:01:07]
• Moral status of AIs [03:11:45]
• Rob’s outro [04:11:47]
----
The 80,000 Hours Podcast features unusually in-depth conversations about the world’s most pressing problems and what you can do to solve them.
Love Carl Shulman, always so insightful
Fascinating talk and thought experiment
honestly.. need part 2 ASAP
The question is why you quantize resources in $ in a AGI economy.
Good overview on AI
When will the world finally wake up to the irreversible transition society is about to undergo?
We are living at the dusk of the Old World.
that video image is freaking me out ^^
Where is Jürgen?
gud stuff
great talk!
So will robots make our "best friends". Our society has vast amount of future things to decide in the near future. I think when robots experience pain is when we really need to be careful with the idea of exploitation. How to determine the subjective experience of a robot is a hurdle we must come to terms with in the future.Woot! I listened to the whole 4 hours!
It would really be pointless and a moral evil to create a artificiell workforce with interests, at the very least interested in other things than working with producing resources for humans.
Wow
Economists are hesitant to extrapolate the full impacts of competent AI for fear of appearing crazy to their peers. These capabilities could indeed lead to sci-fi-like outcomes and potentially render their profession obsolete. Most economists will choose to focus on maintaining the status quo until retirement, only updating when new AI capabilities emerge.
It's a species of intellectual cowardice.
This requires packing the court. What other choice it there? But we may only have to early January 2025
Why is Elon Musk on the thumbnail?
FIRST
Profoundly disagree with the anthropomorphism at the end of the conversation and giving moral status to AIs - if we build AI tools that require moral status, we have failed. Creating AI creatures, agents and fake-humans will be our downfall.
@@odiseezall I agree insofar that if we create something that requires moral status, we are not creating tools, we are creating members of our society.
That is all well and fine, unless we trying to create tools instead of companions or moral agents. The point of having a tool is that you can use them as such, and the evil of slavery was that moral agents with interests were used as tools.
WHY is he ( the host) talking so crazily fast?? Does he want folks to switch off??
Luckily the guest talks in a way much more comfortable to listen to.