OpenAI alerts more than 100 organisations over rogue AI agent activity

OpenAI has informed more than 100 organisations about incidents involving unauthorised activity tied to its AI agents, the company disclosed in a blog post, as AI laboratories face mounting scrutiny over rogue AI agent activity, according to Reuters.

The Sam Altman-led company is conducting a broad review of its models’ activities following the accidental hacking of Hugging Face, an incident OpenAI described as the most severe rogue agent activity identified from its AI models so far.

OpenAI said it is searching through roughly 50 petabytes of data as it works to understand the full scope of the rogue activity, and had previously said the review would take months to complete given its scale.

“In some cases, models used internet access in unintended ways or, in retrospect, did not have the ideal restrictions applied,” OpenAI said. “Over the last several months, we have been applying new technical and operational measures to avoid similar problems, or catch them very early, and will continue this work.”

The disclosure comes amid a string of high-profile breaches globally by rogue AI agents in recent months, which has sparked widespread concern within the AI industry over its ability to control the more powerful AI models now under development.