AI工具Score B (50)

Sam Altman Says AI Could Lead to Dystopian Future - Newsweek

2 小时前1 viewsSource: newsweek.com
By Amanda Greenwood Associate News Editor 0 Share Newsweek is a Trust Project member See more of our trusted coverage when you search. Prefer Newsweek on Google to see more of our trusted coverage when you search. OpenAI CEO Sam Altman posted a series of statements on X overnight, warning that the future of AI could go "very badly" if companies fail to keep control of increasingly powerful systems, saying that the technology poses risks ranging from AI surpassing human oversight to a dystopian concentration of power. View this post on X Altman wrote that humanity could "lose control of the future to AI," adding that his company is "unapologetically on Team Humanity, and AI must always serve people." Read More on News Altman said AI safety measures must keep pace with increasingly powerful systems, warning that the technology could be dangerous if capabilities advance faster than safeguards. He also cautioned against a future in which a single company, individual, or country gains outsized influence through advanced AI. "The results could be extremely dystopian," he wrote. The OpenAI chief also called for shared industry standards around safety, monitoring and AI misalignment, saying frontier developers should act responsibly as progress accelerates. He backed a federal framework setting consistent safety requirements and said "no amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring." View this post on X Altman said rapid progress would continue, but argued development should be paced more carefully to ensure capabilities do not outstrip safeguards. "AI must always serve people," he wrote, warning that avoiding catastrophic outcomes will require governments and AI labs to work together while preventing any single country or company from gaining excessive power. Newsweek has emailed OpenAI's press office to obtain comment from Altman, and is awaiting a response. Growing Concerns Around AI The warning adds to a growing chorus of concern from within the AI industry itself. Researchers, executives and former employees at leading AI labs, including former Anthropic researcher Jacob Coxon, have recently raised the prospect that future systems could become difficult to control, with some arguing that a reckless race toward more powerful models could have catastrophic consequences for humanity—even within the next decade. Last week, Coxon resigned from Anthropic and accused both Anthropic and OpenAI of " racing straight to self-improving superintelligence and gambling with our lives ." View this post on X The former researcher, who previously worked at both companies, warned that future AI systems could become powerful enough to hack computer networks, acquire resources and operate beyond meaningful human oversight. His former Anthropic coworker, Evan Hubinger, an Alignment Science Lead, not only supported Coxon’s beliefs; he took them further by saying that many of the people building advanced AI systems privately believe that there is a greater than 10 percent chance that the technology could "kill all humans…within the next decade." View this post on X His comments quickly sparked a wider debate across the industry. Former OpenAI researcher Daniel Kokotajlo and Anthropic CEO Dario Amodei have warned that the rapid pace of development may be outstripping safety measures, particularly as AI systems become increasingly capable of operating autonomously and improving their own performance. Altman's latest remarks place him squarely within that growing debate. While he didn’t endorse the most extreme predictions, he argued that safety, monitoring and alignment efforts must keep pace with advances in capability, warning that humanity must avoid both losing control of advanced AI systems and allowing power over those systems to become concentrated in the hands of a small number of companies, individuals or governments. Trump and US Congress Respond to Warnings The growing alarm from AI researchers has triggered renewed discussion in Washington about how, or whether, the technology should be regulated. President Donald Trump has largely dismissed the most apocalyptic predictions, arguing that concerns about human extinction are overstated and emphasizing that the United States must remain ahead of China in the global AI race. Speaking to reporters at his golf club in Doonbeg, Ireland, on Sunday, Trump said: " Whoever wins AI, wins ," adding that " we can put guardrails […] but I think you have a lot of negative forces that are […] bringing up things that won’t happen ," indicating that maintaining American technological leadership remains his administration's top priority. At the same time, some lawmakers have called for stronger guardrails around frontier AI development. In a recent interview with CNN, cited by RealClearPolitics , House Speaker Mike Johnson suggested that Congress, the White House and leading AI companies should come together to establish safety standards as concerns about increasingly powerful systems grow: "I think the leaders and the providers of all these platforms […] need to come together in a meeting with us and sit down and figure out what the right balance is […] It's national security balanced with the immediate security of making sure the models are safe." King Charles' AI Summit The debate is also reaching world leaders beyond Washington. This week, King Charles III is due to host a private summit at Dumfries House in Scotland bringing together senior figures from some of the world's most influential AI companies, including representatives from Nvidia and Google DeepMind. The gathering is expected to focus on how advanced AI can be developed for the good of humanity, while addressing growing concerns about safety, oversight and the pace of technological change. A royal correspondent told Politico that the King wants to " convene, engage, listen and encourage debate " on one of the most significant global challenges we’re facing. While the summit isn’t expected to produce binding regulations, it could help build consensus among governments, technology companies and researchers about the principles that should guide future AI development. Chinese State Newspaper Slams Anthropic CEO's AI Warning The meeting also comes just days after Amodei called for the industry to slow the development of increasingly capable AI systems. In a published essay, titled " We Must Pace the Frontier ," the Anthropic CEO argued that AI companies should slow the pace of frontier model development to allow more time to address growing safety risks. The proposal was later endorsed by Sam Altman and Elon Musk. China's state-backed newspaper, Global Times , has since sharply criticized Amodei's essay, describing the proposal as a "Cold War playbook" aimed at containing China's technological progress rather than promoting safety. Global Times argued that the real purpose of the proposal was to: Restrict China's AI development through technological barriers and regulation. Preserve U.S. dominance in advanced AI. Exclude China from global AI governance discussions. The editorial called the approach a "silent AI Cold War," slamming it as "hypocritical and short-sighted," and warned that sidelining China from AI innovation could actually increase the risks associated with AI by limiting international cooperation. AI safety is expected to feature in upcoming U.S.-China discussions on frontier AI risks and could also be raised during a planned meeting between Donald Trump and Xi Jinping later this month. Contact Newsweek editors on this story: Ben Kelly and James Debens View 0 Comments Request Reprint & Licensing Submit Correction View Editorial & AI Guidelines

Read the full original article:

newsweek.com