Anthropic quietly pitches its own AI safety Bill to US lawmakers - CNA

Advertisement Business Anthropic quietly pitches its own AI safety Bill to US lawmakers The Bill would reportedly let the government block a model's release or use only if it poses a foreseeable, imminent risk of more than US$1 billion in damages, or of killing or seriously injuring more than 50 people. People visit an Anthropic booth at Moscone Center during the Dreamforce 2026 technology summit in San Francisco, California, US, Sep 17, 2026. (Photo: Reuters/Carlos Barria) 17 Oct 2026 06:37AM (Updated: 17 Oct 2026 03:16PM) Bookmark Bookmark Share WhatsApp Telegram Facebook Twitter Email LinkedIn Set CNA as your preferred source on Google Add CNA as a trusted source to help Google better understand and surface our content in search results. Read a summary of this article on FAST. Get bite-sized news via a new cards interface. Give it a try. Click here to return to FAST Tap here to return to FAST FAST SAN FRANCISCO: Anthropic representatives have quietly pitched Capitol Hill lawmakers on a draft Bill to regulate frontier AI safety and security, Politico reported on Friday (Oct 16), citing three people with knowledge of the efforts. The Bill would let the government block a model's release or use only if it poses a foreseeable, imminent risk of more than US$1 billion in damages, or of killing or seriously injuring more than 50 people, according to the report. The risk must stem from the creation or release of a biological weapon, the model evading its developer’s controls or a cyberattack, Politico reported. An Anthropic spokesperson told Reuters the Bill represents proposals outlined in Anthropic's "Advanced AI Framework" released earlier this year. CNA Games Guess Word Crack the word, one row at a time Buzzword Create words using the given letters Mini Sudoku Tiny puzzle, mighty brain teaser Mini Crossword Small grid, big challenge Word Search Spot as many words as you can Show More Show Less The Bill would grant the government the "ability to block or deter dangerous deployments of the most powerful models", and also requires developers to test frontier AI models, be transparent about findings, and get them independently evaluated, the spokesperson said. The Department of Commerce did not immediately respond to a Reuters request for comment. Under the Bill, independent evaluators, which would register with the Commerce Department, would be tasked with periodically evaluating the lab and its frontier models, according to the report. The labs could pay these evaluators, provided the payment is not tied to the evaluation's outcome, the report said. If the evaluators determine there is “imminent enumerated risk” for a company’s frontier models, they must report it to Commerce within 72 hours of completing their assessment, Politico reported. While the Commerce Department could request a judge to halt a model after determining risk, the language explicitly prohibits any other US government department, agency, or officer from suspending development, deployment, or internal use, according to the report. A federal judge for the District Court for the District of Columbia could order the suspension of a model, the report said. Related: At Anthropic pre-IPO meet: ‘Thinking’ caps, surging revenue, no human extinction Exclusive-Behind AI industry's call for independent reviews, a fight over what gets made public SECURITY A HOT TOPIC AI policy in the United States under President Donald Trump has relied primarily on voluntary industry pledges and executive orders intended to sustain an AI boom that tech leaders say is driving the country's economy. Congress, politically divided and heavily lobbied by Big Tech, has yet to pass a federal AI law, and is out of session until after next month's midterm elections. Security became a hot topic after recent revelations of security incidents caused by AI agents -- autonomous software that operates without constant human supervision -- that escaped the control of their developers. Anthropic, which was banned from the Pentagon by the Trump administration in February, was forced by Washington in June to suspend its most advanced models for nearly three weeks. Anthropic CEO Dario Amodei called on the industry last month to slow down development, fearing that a group of AI agents could take control of "the entire internet" within six to 12 months. Trump has dismissed the numerous calls to slow down the technology as "negative forces." The proposed legislation would also override certain state laws, such as those in force in California. Anthropic wrote in June that "absent a strong federal law, states should retain full authority to legislate." Charlie Bullock of the Institute for Law & AI think tank praised the proposal as "pretty reasonable," and "more than other frontier labs have done." But he said on X he considers it "weaker" than the FRONTIER Act, a competing Bill introduced in the House of Representatives this summer. Related: Commentary: Who’s paying whom? The circular money machine behind the AI boom Anthropic opens Singapore office, signs AI safety agreement with government Source: Reuters/AFP/cc Newsletter Week in Review Subscribe to our Chief Editor’s Week in Review Our chief editor shares analysis and picks of the week's biggest news every Saturday. Newsletter Morning Brief Subscribe to CNA’s Morning Brief An automated curation of our top stories to start your day. Sign up for our newsletters Get our pick of top stories and thought-provoking articles in your inbox Subscribe here Get the CNA app Stay updated with notifications for breaking news and our best stories Download here Get WhatsApp alerts Join our channel for the top reads for the day on your preferred chat app Join here Related Topics Anthropic artificial intelligence regulation United States Advertisement Also worth reading Content is loading... Advertisement