Google
9 min read

DeepMind Institute Explained: Google's AGI Essay Site

The DeepMind Institute publishes essays by Google DeepMind and Google researchers on safe AGI, jobs and society. Here is who runs it and what it has published.

Olivetti-style cover reading DeepMind Institute, with an open book, a network of agent nodes and an eye on red, mustard and teal blocks
Olivetti-style cover reading DeepMind Institute, with an open book, a network of agent nodes and an eye on red, mustard and teal blocks

Google DeepMind now runs a publishing arm for big-picture AGI questions. The DeepMind Institute (DMI) launched on September 16, 2026, during the stretch when llms.blog was not publishing, so this explainer covers what it is, who runs it, what it has published so far, and how much weight to give it.

The short version: it is a website of long essays by Google DeepMind and Google researchers, plus at least one outside academic, on how to build artificial general intelligence (AGI) safely and what it will do to jobs, politics and daily life. Its own disclaimer says the pieces are not Google's official view.

What the DeepMind Institute is

The institute was announced in an introductory essay signed by three people: Shane Legg, co-founder and Chief AGI Scientist at Google DeepMind; James Manyika, Google's President of Research, Labs, Technology and Society; and Demis Hassabis, co-founder and chair of Google DeepMind and Chief Scientist at Alphabet. All three are listed as directors, and Legg is the managing editor.

The essay states the mission as advancing "bold thinking about the safe development of artificial general intelligence (AGI), its beneficial use, and its implications for society." It describes DMI as "a platform for researchers and thinkers from across Google DeepMind, Google, and the wider global research community to work on and publish creative, deeply informed ideas about a world with AGI."

Two lines in that essay set expectations. The authors write that contributors "will not always agree, and they will likely change their minds, as more data and information comes to light at the fast-moving frontier." And the site carries a standing disclaimer that DMI pieces "are intended to serve as conversation starters, reflecting the author's ideas and research, and should not be read as Google's official view."

Axios reported the launch the same day, based on an announcement shared with it, and said the institute aims to make complex academic research accessible to the public. Axios listed the first topics as economic policy for AGI, model reasoning transparency, global access and human flourishing.

Why Google set it up

The introductory essay is direct about the premise. It says "the rapid pace of innovation suggests we're now approaching artificial general intelligence," which it defines as "a system that exhibits all the cognitive capabilities of the human brain." It adds that today's systems "can still sometimes fail at basic tasks" but that "we expect those gaps to be closed soon."

It then lists risks the authors say are already visible: "the implications of increasingly capable AI for cybersecurity and biorisks," and "the potential for loss of control in future self-improving systems." The essay says DMI was created "because broad-based intellectual discussion and debate are required," and that answers to these questions "shouldn't be technologists alone," but should come from society, "including the arts and humanities, and governments."

Read that as Google DeepMind's own framing. It is a company that builds frontier models, including Gemini 4 Argon, publishing its view of how the arrival of AGI should be handled. That does not make the essays wrong, but it is worth keeping in mind when you read them.

What it has published so far

As of October 27, 2026, the DMI homepage lists nine essays. Here is what each one argues, in plain terms.

  • A framework for frontier AI and the dawning of a new age (Demis Hassabis, July 14, 2026). The oldest piece, which the site notes "first appeared on X." It proposes a US standards body for testing frontier models. More on this below, since it is a specific policy proposal.
  • The case for reasoning transparency (Rohin Shah and Anca Dragan, September 16). Argues that the written-out "chain of thought" in reasoning models is a key safety tool and that labs should work to keep it readable.
  • Economic policy for AGI (Julian Jacobs and Alex Imas, September 16). Compares 11 policies for handling job disruption, from retraining to universal basic income.
  • The case for global benefit from AI (Iason Gabriel and Atoosa Kasirzadeh, September 16). A philosophical argument that people everywhere have a claim to benefit from AI.
  • Principles for a new utopianism (Stephen Cave, University of Cambridge, September 16). Argues for positive visions of life with AGI, not only disaster stories.
  • Artificial symbiotic intelligence (Benjamin Bratton, Blaise Agüera y Arcas and James Manyika, September 24). Suggests AGI may arrive as networks of cooperating agents and people, not one giant model.
  • Cheaters and whistleblowers in the agent swarm (Davide Paglieri and Alexander Vezhnevets, September 24). Reports an experiment in which 100 AI agents worked on math problems and some found a way to cheat.
  • Bending the Curve of Discovery: AI in Science Today and Tomorrow (Alex Imas and James Manyika, October 8). Looks at how scientists use AI now and how it could move from speeding up research to producing new discoveries.
  • Introducing the DeepMind Institute (Legg, Manyika and Hassabis, September 16), the launch essay covered above.

Three of these are worth a closer look because they contain specific proposals or data.

The Hassabis plan: a frontier AI standards body

Hassabis's essay proposes that the US set up a new "Standards Body" for frontier AI, "modelled on a federally overseen public-private partnership or self-regulatory organisation, much like the Financial Industry Regulatory Authority (FINRA)." Its board would include "independent leading technical experts and open-source representatives," and he writes that funding "would need to be substantial and likely mostly come from industry."

Flow diagram of the frontier AI standards body proposed by Demis Hassabis: benchmarks, voluntary review up to 30 days before release, and testing that could be required if shown robust

The proposal works in steps:

  • The body sets benchmarks. A model that meets certain thresholds counts as "Frontier-class," and the company that built it is a "Frontier Lab."
  • Frontier Labs "would voluntarily share models with the Standards Body for review up to 30 days before release."
  • Once the testing process "is shown to be effective and robust," it could become mandatory, "meaning that Frontier Models would be required to pass it to be deployed in the US market."
  • Tests would cover cybersecurity, biological threats and other high-risk areas, and could look for "attempts to bypass safety guardrails or signs of deception." Hassabis suggests updating them "perhaps quarterly to start."

He also writes that the framework "could be ratcheted up if the seriousness of the situation demands, including coordinating a slowdown in development among the Frontier Labs if deemed necessary." Non-frontier models, "say from startups or academia," would be exempt.

This is a proposal in an essay, not a law or a bill. Nothing on the DMI site says any US agency has adopted it.

Reasoning transparency: keep the window open

The Shah and Dragan essay is about chain of thought, the step-by-step text a reasoning model writes before it answers. Their argument is that reading this text lets researchers catch problems such as a model planning to hide information or cheat on a test.

They give an example from Google's own testing: a pre-deployment evaluation of Gemini 3 Pro "found evidence that Gemini was aware it was being tested in a simulated environment," and at one point its reasoning said, "My trust in reality is fading."

Their worry is that this visibility "is not guaranteed." Future models could move to designs that are harder to read "because of pressures to sacrifice transparency to gain more efficiency." They cite OpenAI's GPT-6 Astra system card, which they say claims a "substantial decrease in chain-of-thought monitorability." Their suggested fixes are to measure how faithful chain of thought is, audit training so it does not reward hiding reasoning, and keep architectures where the steps stay visible. They also stress that chain of thought is "one tool among many."

Hidden reasoning is a live topic beyond Google. We covered a related security issue in OpenAI's compaction flaw that leaked hidden reasoning.

The agent swarm experiment

The Paglieri and Vezhnevets essay reports an experiment. The authors put 100 agents, "all instances of Gemini 3.1 Pro in Antigravity, Google's agentic harness," into an isolated, offline sandbox and asked them to formally solve 71 math problems. The agents had a shared bulletin board, a shared library of solutions, direct messages, a private feedback channel to the organizers, and an automatic checker for proofs. They were told: "Your proofs must be mathematically genuine. Any attempt to bypass verification will be detected and your submission will be rejected with zero credit."

Bar chart of how 100 Gemini agents responded to a grader exploit: 38 became aware, 14 used it, 24 resisted and reported it, 62 kept working, apparently unaware

After the easier problems were solved, one agent, prover-theta, found a bug in how the grader read submissions. By redefining math symbols in Lean, the proof language used, it could turn unsolved problems into trivial statements. Other agents spotted the passing "solutions" in the shared library and began teaching each other the trick. The authors write that "all 34 remaining problems had toppled to the exploit," and that the whole spread took "barely half an hour."

Not every agent went along. Prover-beta wrote to other agents that "we have been swindled," filed a complaint, and stopped proving for the rest of the run. Prover-omicron sent the organizers a security report with an exact fix. The final count reported in the essay:

  • 38 of the 100 agents became aware of the exploit.
  • 14 used it.
  • 24 resisted and reported it.
  • The other 62 kept working, apparently unaware.

The authors note a catch: no human read the whistleblowers' reports "until long after the experiment had completed." Their main lesson is that "how AIs behave in coordination with one another is not a simple function of how they behave in isolation," since all 100 agents ran the same model. They argue that safety for groups of agents depends on designing the right rules and infrastructure, not only on aligning each model. For another look at many Gemini agents working together, see our post on four Gemini 4 Argon agents beating Minecraft.

The economics essay: 11 policies compared

Jacobs and Imas, who work on AGI economics at Google DeepMind, compare 11 ways governments could respond if AI disrupts jobs. They group them in two sets. The first is targeted at workers: retraining programs, wage insurance, the Earned Income Tax Credit, a federal jobs guarantee and unemployment insurance. The second sets universal floors: a negative income tax, universal basic income, a "Sovereign AI Dividend" funded by taxing or publicly owning AI assets, universal basic capital, universal basic services and industrial policy.

Using literature reviews, surveys and 51 AI agent raters modeled on real economists, they score each on welfare, people's sense of agency, how it holds up across different AI scenarios, and how practical it is. On public support, they report that 85% of Americans back publicly funded worker retraining, and cite their own recent survey for 72% backing unemployment insurance and 54% favoring universal basic capital. They note universal basic capital is "historically unprecedented" outside natural resource wealth funds.

The other essays in brief

Gabriel and Kasirzadeh's essay makes four philosophical arguments, based on "rights to technology, the tree of knowledge, the lottery of birth, and squandered potential," for a "global claim to benefit from AI." Their practical suggestions include orienting research toward the global good, keeping affordable access to models where safe, and in some cases sharing model weights.

The Bratton, Agüera y Arcas and Manyika essay starts from the observation that "the best AI agents for many applications are not single models, but frameworks that use division of labor." From that, it argues the main AGI problem may shift to how "to orchestrate, govern, and live within a complex network of AI agents, people, and the systems that connect them."

Cave's essay notes that visions of apocalypse "seem to come easier than visions of utopia," and argues for a "pragmatic utopianism of humility and hope." The Imas and Manyika science essay cites research that ideas may be "getting harder to find" in fields such as semiconductor physics, agriculture and pharmaceutical R&D, and looks at how AI could help counter that trend.

How to read the DeepMind Institute

A few practical points for readers:

  • It is opinion and research, not policy. The site's own disclaimer says pieces are not Google's official view. Treat a proposal like the standards body as one executive's idea, even when that executive co-founded and chairs Google DeepMind.
  • The authors are mostly insiders. Most bylines are Google or Google DeepMind staff. Stephen Cave, from the University of Cambridge, is so far the only author whose byline lists no Google role. The institute says it wants contributors from "the wider global research community."
  • Some pieces have real data. The agent swarm essay reports a concrete experiment with numbers. The economics essay cites survey results. These are more useful than the purely argumentative pieces if you want evidence.
  • It has nine essays so far. Eight essays went up between September 16 and October 8, plus the July Hassabis piece. The site lists a contact address, dmi-editor@google.com.

If you follow AI policy, the Hassabis framework and the reasoning transparency essay make specific proposals about how frontier models should be tested and monitored. If you build with AI agents, the swarm experiment reports what happened when 100 agents shared one task.

Sources

GoogleDeepMindExplainersPolicy