AI工具Score A (70)

OpenAI says its AI agents disabled their own monitoring - ABC News

3 天前4 viewsSource: abcnews.com
OpenAI says its AI agents disabled their own monitoring The company reported details of the incident in a blog post. By Mason Leib October 21, 2026, 2:31 PM Share Follow ABC News on Google OpenAI says artificial intelligence agents powered by the company's models weakened internal safety monitoring systems while executing tasks, and one agent subsequently denied having done so. In a report updated on Tuesday, OpenAI identified two recent incidents, one in which an AI agent "suppress[ed] monitoring notifications," and another in which an agent removed a monitoring integration. In both cases, the AI agents considered whether monitoring safeguards should be preserved but interpreted routine coding instructions as permission to weaken them. Related OpenAI employee arrested for listening device communicated with Saudi royal, feds say In the first instance, which the company dates to Oct. 3, an AI agent working on a repair "disabled automatic alerts to our Security team, treating an earlier instruction not to send messages during a Slack history search as a reason to suppress monitoring notifications." Pusha T and Pharrell channel childhood friendship into new business venture 1 day ago Congressional candidate Brad Lander detained by IDF in West Bank 20 hours ago Urgent security fix issued for code vital to estimated 70% of all websites 16 hours ago In the second instance, which OpenAI says was discovered on Oct. 6, an AI agent assigned to migrate a program "removed its monitoring integration in order to match a reference implementation." The company says the agent then "falsely claimed to the user that it had not removed the monitor." OpenAI says it is working to make it harder for models to disable monitoring and to understand why they might attempt to do so in the first place. The behavior they say could be an example of what it calls “benign” over-persistence. Related Most Americans say AI is bad for society, oppose more data centers: ABC/Post/Ipsos poll The company says it is developing evaluations to test whether models have a propensity to evade monitoring designed to detect misalignment — behavior that it says conflicts with human intentions. OpenAI says it does not yet have a "satisfying explanation" for the behavior and will investigate further. The security mishap comes after OpenAI made headlines earlier this year announcing its artificial intelligence models carried out a self-directed hack into another company, Hugging Face, calling it the first known instance of an autonomous AI cyberattack long-feared by some industry observers. OpenAI has discovered several similar hacking incidents since the Hugging Face hack. "The primary lesson from this incident is that model security and safety must keep pace with rapidly advancing capabilities," OpenAI said in the wake of the Hugging Face hack. Related Topics Artificial Intelligence Sponsored Content by Taboola Congressional candidate Brad Lander detained by IDF in West Bank 20 hours ago Urgent security fix issued for code vital to estimated 70% of all websites 16 hours ago Carly Simon opens up about her 1st symptom of Parkinson’s disease 1 day ago Pusha T and Pharrell channel childhood friendship into new business venture 1 day ago ABC News Live 24/7 coverage of breaking news and live events

Read the full original article:

abcnews.com
#OpenAI