Adapting the Interface, Not the Model: Runtime Harness Adaptation for Deterministic LLM Agents

Published
Source
arXiv
Paper number
218
Field
AI / General
arXiv ID
2605.22166

Key points

  • Action realization failure, or 33.3 percent, occurs when the model has the right intent but fails to express it in an executable format, such as by omitting arguments, using the wrong delimiter, or generating free-form text instead of structured tool calls.
  • Environment contract mismatch, or 23.2 percent, occurs when the model generates a syntactically valid action but violates the concrete rules of the tool or API, such as by accessing a non-existent database column or using an invalid flight code.
  • Trajectory degeneration, or 33.6 percent, occurs when the agent falls into a degenerate state, such as repeating the same invalid action, stalling without progress, or failing to recover from an error even after receiving feedback.

Paper links

External research summaries. These are not HDATF publications or measured product results.

Read original (opens in a new tab)