How to stop runaway AI

How can humans retain power over more intelligent AI beings?
Dr. Stuart J. Russell is a Professor of Computer Science at UC Berkeley and has been studying the development of artificial intelligence for decades.
Subscribe to Freethink on Substack for free
Get our favorite new stories right to your inbox every week

While he doesn’t think this latest crop of generative AI tools necessarily presents a significant threat to humanity, he does think it has helped to open the public’s eyes to the potential risks of more intelligent AI that could be coming in the future.

“They’re giving people now, in a very real sense, what would it be like if we had artificial general intelligence on tap available 24/7 to solve any problem that we might have. And they’re also seeing in a very visceral way that could present real risks,” Russell explained in a recent interview with Freethink.

As Russell argues in his book Human Compatible: Artificial Intelligence and the Problem of Control, we need to be appropriately concerned about the future threat of human-level, artificial general intelligence (AGI) which could pose an existential threat to humanity unless we can ensure that these systems remain aligned with human values and goals.

He contends that the standard approach to designing AI systems — in which machines are programmed to maximize some objective function — is fundamentally flawed because these machines don’t actually understand the world around them in any comprehensive way, a flaw that, in his mind, could lead to unintended and catastrophic failures if it can’t sufficiently anticipate the consequences of its own actions. Instead, he proposes a new approach to AI design in which machines are explicitly programmed to defer to humans in matters of value and to operate within a framework of uncertain and incomplete knowledge. By ensuring that AI systems are “human-compatible” in this way, Russell argues that we can harness the enormous potential of AI while minimizing the risk of catastrophic outcomes.

Related
Jony Ive has found his new Steve Jobs
Jony Ive and Sam Altman join forces as OpenAI acquires io, Ive’s secretive AI hardware startup, for $6.5 billion.
Why Substack will be the intellectual engine of the 21st century
The 21st-century version of the Royal Society could be the Substack network that we are just starting to build out today.
Vibe coding is rewriting the rules of technology
Rather than meticulously crafting each line of code, developers can now “vibe” with AI tools using natural language.
Cheap AI is causing a power shift in the world’s militaries
The militaries that leverage the low-cost capabilities of AI the most will have a decisive advantage in the future.
Media has a blind spot when covering the AI panic
When news outlets quote warnings of an impending AI catastrophe, they rarely mention the two main movements behind this narrative.
Subscribe to Freethink for more great stories