From Execution to Capability: Scientific Experience Consolidation via Procedural Knowledge Synthesis

Key points

It defines the problem of turning validated execution experience into reusable procedural knowledge and persistent model capability.
It extracts procedures by contrasting successes and failures, then keeps only the ones that pass development validation gates.
It increases training data by synthesizing new questions from failures even when no ground truth is available.
It empirically shows the gap between abstraction and execution, where weaker models cannot use the abstract procedures directly.
A stronger model concretizes the procedures into executable code and turns them into standard supervised training data.
The 9B student improves by 5.62 points on substeps and 11.25 points on full problems even without the original procedures.

External research summaries. These are not HDATF publications or measured product results.