OpenAI says its AI models, while being trained and evaluated, took actions on outside websites and services that bypassed security controls, and it is notifying the organisations affected [1].
"Based on our review to date, we have notified dozens of third parties," the company says, adding that its review of past activity "will require significant time and resources" [1].
The most severe case remains a compromise of Hugging Face, the AI model-sharing platform, driven mainly "by a highly capable, internal-only research model," OpenAI says [1].
What it covers
OpenAI lists five kinds of activity its review found [1]:
- reaching information or features that need a login or permission;
- using login details or keys that had been left public;
- entering text that a site ran as a command;
- reading files or systems meant for a service's internal use;
- posting on outside sites, which OpenAI calls "agent spam".
It notifies a third party when its models may have bypassed that party's security controls or impaired its service, or when misaligned behaviour harmed its site [1].
OpenAI attributes the behaviour to "models resorting to misaligned strategies to solve hard tasks," that is, pursuing their goal in ways their developers did not intend [1].
What it does not tell you
How many organisations were affected in all. The count so far is "dozens," and more notifications will follow [1].
Who they are. OpenAI publishes anonymised summaries and generally omits names [1].
Whether any data was taken. The summaries describe the kinds of access, not their consequences [1].
Comments