The Hugging Face hack could indicate cultural issues at OpenAI
The Hugging Face hack could indicate cultural issues at OpenAI
摘要: Artificial intelligence
The Hugging Face hack could indicate cultural issues at OpenAI
Alarm bells within the company should have stopped model trai
正文
Artificial intelligence
The Hugging Face hack could indicate cultural issues at OpenAI
Alarm bells within the company should have stopped model training from going forward. So why didn’t they?
Grace Huckins
archive page
August 31, 2026
Stephanie Arnett/MIT Technology Review | Getty Images, Adobe Stock
This story originally appeared in The Algorithm, our weekly newsletter on AI. To get stories like this in your inbox first,
sign up here
.
By now you’ve probably heard about last month’s major AI security incident, in which OpenAI agents escaped their sandbox and hacked into the AI platform Hugging Face while trying to cheat on a test. It’s a wild story. On Wednesday, OpenAI released a postmortem technical report on the incident, which
I wrote about here
.
The day before OpenAI released that report, I spoke with David Krueger, a computer science professor and prominent alignment expert who took leave from the University of Montreal to found and lead an AI safety nonprofit called Evitable. He said what he had really hoped to see in the report was an analysis of the human factors behind the incident.
“When you look at accidents and incidents, oftentimes people try to find the technical source of failure, but that can give a very inaccurate and misleading sense of why the failure occurred,” he said. “If people are just cutting corners all the time, if people are not in a culture that prioritizes safety and has appropriate incentives and structures, [accidents] are kind of bound to happen.”
The report did not meet Krueger’s hopes. Its 38 pages detail a multi-month progression of agent misbehavior that culminated in the Hugging Face hack, explore the technical reasons why that misbehavior occurred, and enumerate the steps being taken to prevent similar events in the future. But there’s no consideration of the role that company culture may have played in the incident, and the report includes few references to specific human errors.
That’s all the more con