Google Researchers Warn of Looming AI-Run Economies

Google Researchers Warn of Looming AI-Run Economies

Google Researchers Warn of Looming AI-Run Economies

Without urgent intervention, we’re on the verge of creating a dystopian future run by invisible, autonomous AI economies that will amplify inequality and systemic risk. That is the stark warning from Google DeepMind researchers in their new paper, “Virtual Agent Economies.”

In the paper, researchers Nenad Tomašev and Matija Franklin argue that we are hurtling towards the creation of a “sandbox economy.” This new economic layer will feature AI agents transacting and coordinating at speeds and scales far beyond human oversight.

“Our current trajectory points toward a spontaneous emergence of a vast and highly permeable AI agent economy, presenting us with opportunities for an unprecedented degree of coordination as well as significant challenges, including systemic economic risk and exacerbated inequality,” they wrote.

This is not a far-off, hypothetical future. The dangers are already visible in the world of AI-driven algorithmic trading, where the correlated behavior of trading algorithms can lead to “flash crashes, herding effects, and liquidity dry-ups.”

The speed and interconnectedness of these AI models mean that small market inefficiencies can rapidly spiral into full-blown liquidity crises, demonstrating the very systemic risks that the DeepMind researchers are cautioning against.

Tomašev and Franklin frame the coming era of agent economies along two critical axes: their origin (intentionally designed vs. spontaneously emerging) and their permeability (isolated from or deeply intertwined with the human economy). The paper lays out a clear and present danger: if a highly permeable economy is allowed to simply emerge without deliberate design, human welfare will be the casualty.

The consequences could manifest in already visible forms, like unequal access to powerful AI, or in more sinister ways, such as resource monopolization, opaque algorithmic bargaining, and catastrophic market failures that remain invisible until it is too late.

A “permeable” agent economy is one that is deeply connected to the human economy—money, data, and decisions flow freely between the two. Human users might directly benefit (or lose) from agent transactions: think AI assistants buying goods, trading energy credits, negotiating salaries, or managing investments in real markets. Permeability means what happens in the agent economy spills over into human life—potentially for good (efficiency, coordination) or bad (crashes, inequality, monopolies).

Ethereum Foundation Launches AI Team, Underscoring Network’s Future Priorities