Score B (63)
Dario Amodei's thought experiment for 2027: imagine the equivalent of 50 million ... - Science Blog
7 小时前2 viewsSource: scienceblog.com
Dario Amodei wants readers to imagine a new country appearing around 2027. It has the equivalent of 50 million residents, each intellectually more capable than the best human scientists, engineers and political leaders. Its citizens can process information and act far faster than people, yet none has a body. They are AI instances running on computing infrastructure. The Anthropic chief executive calls this a “country of geniuses in a datacenter.” It is among the most striking descriptions of powerful AI offered by the leader of a frontier laboratory. It is also a constructed scenario, assembled from several assumptions that need to be kept separate: superhuman breadth, long-term autonomy, millions of copies, extreme operating speed and enough computing capacity to run them together. The 50 million figure is an analogy Amodei set out the scenario in his January 2026 essay The Adolescence of Technology . His formal definition begins with a model, or perhaps several interacting models, that is better than the strongest humans across most relevant intellectual fields. It can use digital interfaces, pursue assignments lasting hours, days or weeks, direct experiments and control existing tools through computers. He then adds scale. The computing resources used to train the model could be repurposed to run millions of instances, which could work on unrelated tasks or collaborate. Later, when turning the definition into a geopolitical thought experiment, he asks readers to imagine 50 million people materialising in about 2027. The definition first appeared in Amodei’s 2024 essay Machines of Loving Grace , which focused on possible benefits in biology, neuroscience, economic development and peace. The 2026 essay retains the same technological premise and turns towards the dangers of reaching it. Those are not identical claims. “Millions” is part of the proposed technical definition. Fifty million is an illustrative population chosen for the country analogy. The essay does not show a capacity calculation in which a named model, a specified number of accelerators, memory, networking and electricity produce exactly 50 million concurrent agents. It is a round scenario number, not a measured headcount or a forecast with error bars. What “100 times faster” means Amodei writes that a powerful model could absorb information and generate actions at roughly 10 to 100 times human speed. That is the source of the headline’s upper bound. In the later national-security analogy, he describes AI operating hundreds of times faster but gives the imagined country a ten-to-one advantage in cognitive actions. The text itself therefore treats speed as a simplifying parameter, not a single measured constant. Fast token generation would not make every surrounding process 100 times faster. Software can impose delays. Networks take time. Laboratories must order materials, grow cells and run instruments. Robots move through a physical world governed by mechanics and chemistry. Amodei explicitly notes that response times outside the model could become limiting. Speed also differs from reliability. If one copy repeatedly makes the same mistaken assumption, creating another million copies may reproduce the error rather than cancel it. Productive collaboration would require task allocation, communication, conflict resolution, shared records and verification. A digital population can be copied cheaply relative to people, but its useful output need not rise in direct proportion to its instance count. One or two years is the aggressive case Amodei says powerful AI could be as little as one or two years away. In the same sentence, he says it could be considerably further out. Elsewhere he describes a decent chance of arrival on the shorter timeline and a very strong chance within the next few years. That language expresses a forecast with acknowledged uncertainty, not a promise that the system will switch on during 2027. His argument rests partly on scaling laws: across successive generations, more computation and training have produced relatively predictable gains on many measured capabilities. He also expects a feedback loop as AI writes more of the code used to build later AI systems. If a current generation can autonomously improve the next, the pace could accelerate. Both steps are extrapolations. Benchmark trends do not by themselves establish Nobel-level originality across biology, mathematics, engineering, writing and statecraft. AI-assisted coding does not show that a model can choose a research direction, recognise a misleading result, coordinate a laboratory and sustain good judgment for months without human leadership. Amodei is a unusually informed observer of frontier development, but he is also the chief executive of a company building and selling the technology whose trajectory he predicts. Present systems show progress and a large gap Anthropic’s own current reporting makes the contrast unusually clear. Its August 2026 transparency hub says Claude Opus 5 reaches state-of-the-art performance on some coding and knowledge-work evaluations. Yet Anthropic says the model has not crossed its threshold for automated AI research, is not close to substituting for its research scientists and engineers, and has not caused a sustained doubling in the company’s pace of AI progress. That is not evidence that Amodei’s scenario will fail. Forecasts concern systems that do not exist yet. It does establish the baseline from which his one-to-two-year prediction must climb. The current frontier, by its developer’s assessment, remains below autonomous replacement of an entry-level research role, let alone 50 million independent minds exceeding every Nobel laureate. Independent evaluation supplies a similar mixture of rapid progress and narrow evidence. METR’s task-completion time horizons have risen sharply, but the suite is concentrated in software engineering, machine learning and cybersecurity. The 50 percent time horizon is the human time associated with tasks a model is predicted to complete half the time. It is not the length of time the model can reliably work alone, and METR cautions that estimates above 16 hours are currently unreliable. ScienceBlog recently examined a different scale of AI evidence: a small latent-reasoning model on ARC-AGI-1 . Its impressive cost result applied to coloured-grid puzzles, not general intelligence. The contrast matters because capability claims are only as broad as the tasks, success criteria and operating conditions that generated them. A data centre is not a sovereign state The country metaphor is useful because it forces questions about concentrated capacity. A digital workforce of that scale could divide its effort among software, cyber operations, scientific research, persuasion and strategic planning. If controlled by one company or government, it could shift economic and political power even without behaving as an independent agent. But a country normally contains people with diverse aims, bodies, legal standing, property and relationships. Model copies may be near-identical, centrally instructed and dependent on the same hardware. Calling them residents can hide correlated weaknesses and exaggerate social diversity. Calling the hosting system one data centre can also hide a likely network of facilities, power suppliers, chip manufacturers, telecommunications links and human operators. The physical layer is not a footnote. Running more instances requires accelerators, memory bandwidth and electricity, while useful action requires connections to databases, instruments and institutions. ScienceBlog has previously examined the projected electricity and water footprint of global data centres . A country-scale cognitive metaphor still has an industrial base. The point is a stress test, not a population forecast Amodei uses the thought experiment to organise five categories of risk. A superhuman digital country might pursue goals humans do not share. People could misuse it for destruction. A ruler or corporation could use it to seize power. Even peaceful participation could displace work and concentrate wealth. Rapid inventions could generate destabilising effects that neither the AI nor its operators intended. These questions do not require confidence in the exact number 50 million. Institutions can plan for stronger cyber defence, model evaluations, compute security, labour disruption and accountability before AI reaches Amodei’s threshold. Conversely, treating the scenario as an established 2027 engineering schedule can weaken the discussion by making a provocative analogy look like measured capacity. The most accurate reading is conditional. Amodei believes a model with extraordinarily broad competence may arrive soon, that future clusters could run millions of copies, and that digital work could proceed much faster than human thought. He then asks what follows if those assumptions combine at country scale. His “country of geniuses” is not waiting inside a data centre today. It is a forecasted capability wrapped in a geopolitical analogy, valuable precisely because it makes an uncertain future concrete enough to test. A Science Blog column The Long View The Long View steps back. A single finding rarely means much on its own, so this desk connects new research to what came before it, across physics, biology, medicine, and everything in between. Read the column →
Read the full original article:
scienceblog.com