AWS open-sources Infinity, a runtime for massive agent concurrency

Summary

AWS and UC Berkeley released Infinity, an agent runtime, under the Apache 2.0 license as part of the Hydro project. While a tool call is in flight, the runtime saves the whole agent and resumes it when the result arrives. In the company's benchmark, 75,000 concurrent agents fit in the 8 GB of memory of a Raspberry Pi 5. AWS describes it as an early research release aimed at gathering feedback.

Why it matters for our work

It demonstrates in working code that the costly part of an agent is often the waiting rather than the thinking. It gives teams an experimental base for running agents cheaply on serverless platforms when builds or approvals take hours or days.

Translated from the Korean original. Summaries may be translated and edited. Commentary reflects our perspective; forecasts remain the source’s views.