Active Context Compression: Autonomous Memory Management in LLM Agents

Key points

• LLM agents suffer from context bloat on long tasks because their conversation history keeps growing, which raises compute cost and latency.
• An expanded context window can reduce reasoning quality through context poisoning, where irrelevant information overwhelms the useful content, and through the lost-in-the-middle effect.
• Existing solutions such as external memory systems and reflection mechanisms often fail to provide active in-trajectory context management during sustained task execution.
• The Focus architecture extends the ReAct agent loop with two primitives, Focus Begin and Focus Complete, so that the agent can autonomously start and end compression phases.
• At Focus Complete, the agent generates a high-level summary of its activity and learning, appends it to a persistent Knowledge block, and deletes the raw interaction history to create a dynamic sawtooth context pattern.
• This approach is inspired by biological exploration strategies such as slime mold behavior and emphasizes synthesis of abstract learning over preservation of the full raw record.

Paper links

External research summaries. These are not HDATF publications or measured product results.