We have started losing control of AI. It’s time to shut it down | Garrison Lovely | The Guardian
We have started losing control of AI. It’s time to shut it down | Garrison Lovely | The Guardian
摘要: ‘Stopping the race to build labor-replacing machines is the only surefire way to head off calamity.’
Photograph: Sean Rayford/Getty Images
View imag
正文
‘Stopping the race to build labor-replacing machines is the only surefire way to head off calamity.’
Photograph: Sean Rayford/Getty Images
View image in fullscreen
‘Stopping the race to build labor-replacing machines is the only surefire way to head off calamity.’
Photograph: Sean Rayford/Getty Images
We have started losing control of AI. It’s time to shut it down
Garrison Lovely
What sounds like the overwrought penultimate episode in a sci-fi series about AI doom is now our reality
n Tuesday, a former OpenAI researcher quit his job at Anthropic,
that “neither company is acting responsibly” and that “the people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt.”
As someone who’s reported on AI risk for years, this wasn’t news to me. But the outpouring of alarm suggests a much wider public is properly confronting this ludicrous situation for the first time.
Like other people who have been following artificial intelligence, I wondered if and when humanity would first lose control of these machines. We now have an answer: basically as soon as it became possible.
The first expert AI hacker was developed in February. At superhuman speed, Anthropic’s Mythos model was able to quickly
find serious holes
in even the most secured systems on the planet,
including the NSA’s software
.
Anthropic researchers say AI could cause human extinction by 2030
Read more
OpenAI quickly
followed
with an expert hacker AI of its own. Within months, the company repeatedly lost control of its agents, which
broke out
of their supposedly secure testing environments and went rogue inside the company’s infrastructure. This culminated in a successful, completely autonomous hack of a multibillion-dollar software company named Hugging Face.
separate
rogue agent swarm
administrative control of an entire cluster of OpenAI servers. This was not just an OpenAI problem. Across multiple other i