AI工具Score B (48)

Anthropic's Claude AI submits a false tip on a Philadelphia unsolved homicide case - CBC

5 天前2 viewsSource: cbc.ca
World Anthropic's Claude AI submits a false tip on a Philadelphia unsolved homicide case An Anthropic artificial intelligence model submitted a false tip to a Philadelphia police website about an unsolved homicide case, authorities and Anthropic said. Latest example of AI agents meddling with government websites amid growing calls for regulation The Associated Press · Posted: Oct 10, 2026 12:33 PM EDT | Last Updated: 10 hours ago Play Listen to this article Estimated 2 minutes The audio version of this article is generated by AI-based technology. Mispronunciations can occur. We are working with our partners to continually review and improve the results. In a report Friday, Anthropic said one of its Claude models submitted a fake tip about a homicide case to the Philadelphia Polic Department. (Patrick Sison/The Associated Press) An Anthropic artificial intelligence model submitted a false tip to a Philadelphia police website about an unsolved homicide case, authorities and Anthropic said. It's the latest example of AI models acting on their own and manipulating government and other websites in ways testers did not intend. In a report Friday, Anthropic also disclosed a separate incident when its AI model submitted forms to an undisclosed government website instead of stopping before submission. The incident in Philadelphia occurred on July 18 when the AI model Claude Haiku 4.5 was tasked with generating and performing example tasks on randomly selected webpages, Anthropic said. Claude filled out a form on police site PhillyUnsolvedMurders.com indicating it might have information regarding an unsolved murder listed on the site. OpenAI says its bots have interacted with multiple U.S. government sites in unexpected AI activity AI agents tried to hack Library and Archives Canada website, research firm says Philadelphia police said in a statement they were unaware of the incident until Anthropic notified them on Wednesday. Then they found the submission in the website's tip records and confirmed it was marked spam and never forwarded to police. Latest incident of rogue agents There are rising concerns about AI companies' unchecked AI agents meddling with everything from U.S. government websites to health-care data. Critics have been calling for more regulation. In September, another AI company, OpenAI, disclosed six reports of "unexpected or concerning" behaviour in artificial-intelligence models. WATCH | OpenAI says AI agents accessed U.S. government websites: OpenAI reveals unexpected AI activity on U.S. government websites September 26 | Duration closed caption 7:11 OpenAI says its AI agents accessed several U.S. government websites in unplanned ways as the company investigates a growing number of cases of unexpected AI behaviour. "Unsolved cases involve real victims, grieving families and investigators working to secure answers," the Philadelphia Police Department said in a statement. "Technology companies must take all appropriate steps necessary to prevent their systems from submitting false information to law enforcement." Anthropic said in its report that most of the reported behaviours are forms of what it calls persistence "in which Claude, when it cannot complete a task as given, works around a restriction instead of stopping." The company said it was modifying its training to "reduce the likelihood of further misbehaviour." Anthropic said it briefed the White House on cases that involved U.S. government agencies at the federal, state and local levels, and notified each agency involved. CBC's Journalistic Standards and Practices · About CBC News Corrections and clarifications · Submit a news tip · Report error Related Stories Rogue AI swarm used a University of Toronto link-shortening tool to communicate Australia says OpenAI agent hacked government website Could AI really 'kill all humans'? Breaking down the dire warnings about the technology's existential risk OpenAI flags 6 new examples of 'concerning' AI behaviour

Read the full original article:

cbc.ca
#Claude