Looped Diffusion Language Models
- Published
- Source
- arXiv
- Paper number
- 245
- Field
- Machine Learning
- arXiv ID
- 2605.26106
Key points
- The Head is made of a fixed number of layers that run once at the start of the forward pass, and its main role is to process the initial input embedding and provide a starting representation for the rest of the network.
- The Tail is made of a fixed number of layers that run once after the Mid-block finishes looping, and these layers finalize the representation and project it into vocabulary space for token prediction.
Paper links
External research summaries. These are not HDATF publications or measured product results.