Xiaoxuan Guo

Author directory

2026

Verifiable reasoning training compresses an entire response to a binary pass-or-fail label, yet a fail label alone does not reveal whether the corresponding trajectory should be discarded, penalized, or repaired. Many failed trajectories remain close to the correct solution through substantial portions of their intermediate reasoning and deviate only at a later branching point, whereas others contain no reliable prefix that can support a correct suffix. Treating both failure types as uniformly negative supervision suppresses useful reasoning states while reinforcing erroneous ones. To address this limitation, we propose prima, which decomposes failed trajectories into inheritable prefixes and divergent suffixes, and rewrites repairable failures into shared-prefix preference pairs for localized reasoning optimization. We formalize the optimization cost of mixing the two failure types and show that treating them as a uniform negative class shrinks effective gradient magnitude, providing a principled justification for separating repairable from irrecoverable failures before training. Experiments show that prima converts failed trajectories from coarse-grained negative supervision into cleaner suffix-level supervision signals, leading to consistent gains on code and mathematical reasoning tasks.