ReBound: Relevance-Boundary Supervision for Distractor-Robust Mathematical Reasoning

Jiahui Long, Lidan Shou, Huan Li, Ke Chen


Abstract
Mathematical word problems with plausible irrelevant context expose a failure mode in which language models reason from facts that should not support the target solution. We formulate distractor-robust mathematical reasoning as relevance-boundary supervision: a model should separate Signal facts from Distractor facts before solving, and then ground the solution in Signal facts only. We introduce ReBound, a post-training framework that constructs paired clean–distractor examples, trains boundary-first traces with supervised fine-tuning, and applies correctness-guided reinforcement learning to discourage Distractor use. Across three open base LLMs and six mathematical reasoning benchmarks, ReBound consistently improves distractor robustness over CoT prompting and strong training-based baselines; on Qwen3-0.6B, the distractor benchmark average increases from 34.92 to 48.29. ReBound also preserves competitive clean and perturbation performance. Process diagnostics, ablations, and output-length analysis show that these gains are tied to better fact use and boundary behavior, rather than longer generations or answer-only optimization.The code is available at https://anonymous.4open.science/r/Rebound-5FB8
Anthology ID:
2026.findings-emnlp.2402
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
51612–51627
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2402/
DOI:
Bibkey:
Cite (ACL):
Jiahui Long, Lidan Shou, Huan Li, and Ke Chen. 2026. ReBound: Relevance-Boundary Supervision for Distractor-Robust Mathematical Reasoning. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 51612–51627, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ReBound: Relevance-Boundary Supervision for Distractor-Robust Mathematical Reasoning (Long et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2402.pdf