Thinking with Imagination: Agentic Visual Spatial Reasoning with World Simulators
- Published
- Source
- arXiv
- Paper number
- 367
- Field
- Computer Vision
- arXiv ID
- 2606.06476
Key points
- It formulates spatial reasoning as an interactive evidence-gathering problem, so the VLM actively requests and uses imagined visual evidence.
- It applies view-consistency tuning to Astra-WM to address the lack of spatial consistency in existing image generation models.
- A two-stage RL curriculum teaches valid simulator calls in stage 1 and encourages selective imagination in stage 2.
- It shows that simply connecting a simulator to Qwen3-VL degrades performance, but meaningful gains appear after RL training.
- It shows that useful imagination requires both a high-quality world simulator and an agent policy that decides when, where, and how to imagine.
Paper links
External research summaries. These are not HDATF publications or measured product results.