Neural Computers
- Published
- Source
- arXiv
- Paper number
- 136
- Field
- LLMs / Architecture
- arXiv ID
- 2604.06425
Key points
- Traditional computers, AI agents, and world models often split computation, memory, and input-output into separate hardware or software modules, or into external execution environments.
- Existing systems depend on explicit, human-designed instruction sets, which can become rigid in domains that require high-dimensional, statistical, and globally coupled processing.
- Existing AI agents usually mediate an external execution environment rather than internalizing the executable state into the computer itself.
- This paper proposes Neural Computer (NC), in which the neural network itself acts as an active computer by internalizing computation, memory, and input-output within a latent runtime state.
- NC is implemented as a video model that can roll out screen frames based on commands and user actions, and it is trained directly on input-output traces from command-line interface (CLI) and graphical user interface (GUI) environments.
- The method includes using a diffusion transformer, a VAE, and specialized techniques for action injection and cursor supervision to develop interface-specific prototypes called NC-CLIGen and NC-GUIWorld.
Paper links
External research summaries. These are not HDATF publications or measured product results.