Reliability-Calibrated Guidance for Few-Step Categorical Flow-Map Text Generation

Zihao Liu, Hongchen Wu, Xiaochang Fang, Hongxuan Li, Huaxiang Zhang, Jiande Sun


Abstract
Few-step flow-map guidance provides an efficient way to steer generation without retraining, but its updates are defined in a continuous or relaxed state space. In categorical text generation, however, the final output is determined by simplex-constrained token distributions and hard decoding. Under low NFE, where each update induces a relatively large finite displacement, this continuous-to-discrete mismatch can make terminal reward guidance unreliable, causing overshoot, reward–quality conflict, saturation, or poor transfer from relaxed reward gains to decoded tokens.

We present Reliability-Calibrated Flow Guidance (RCFG), a sampling-time reliability-calibration framework for terminal reward pullback in few-step categorical flow maps. Rather than replacing the underlying guidance primitive, RCFG calibrates its magnitude and direction according to transition scale, reward saturation, local reward–quality conflict, and categorical endpoint structure. Experiments on LM1B and Text8 show more favorable aggregate control–likelihood operating points after calibration: on LM1B, RCFG maintains or improves verifier Reward and Target while reducing NLL and PPL relative to terminal reward-pullback guidance, while Text8 shows a modest aggregate improvement in lexical-control balance. Code and reproduction instructions are available at: https://github.com/ZionLau/RCFG
Anthology ID:
2026.findings-emnlp.1995
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
42517–42546
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1995/
DOI:
Bibkey:
Cite (ACL):
Zihao Liu, Hongchen Wu, Xiaochang Fang, Hongxuan Li, Huaxiang Zhang, and Jiande Sun. 2026. Reliability-Calibrated Guidance for Few-Step Categorical Flow-Map Text Generation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 42517–42546, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Reliability-Calibrated Guidance for Few-Step Categorical Flow-Map Text Generation (Liu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1995.pdf