Streaming Multi-Agent Autoregressive Diffusion Model with World State Registers

Published
Source
arXiv
Paper number
703
Field
Computer Vision
arXiv ID
2607.21594

Key points

  • It uses a world-state register, which is a learnable token, to explicitly manage shared state across multiple agents.
  • The register is grounded with three supervision signals: agent state, bird's-eye view, and scene text.
  • A Mixture-of-Transformers structure reduces interference between state updates and frame generation.
  • The Self-Forcing paradigm is used to update the register dynamically during long-horizon rollouts.
  • In two-agent Minecraft experiments, both logical consistency and generation quality improve.

Paper links

External research summaries. These are not HDATF publications or measured product results.

Read original (opens in a new tab)