GROVE: Graph-based Routing Over Variant Experts for Adaptive Two-Stage Training of Reasoning Models

Yiming Luo, Chunlin Tian, Li Li


Abstract
Post-training reasoning models is computationally expensive, and the allocation between supervised fine-tuning (SFT) and reinforcement learning (RL) substantially affects reasoning quality. Existing methods operate at the training-procedure level and treat the reasoning corpus as homogeneous, ignoring the structural heterogeneity of individual traces. We propose GROVE (Graph-based Routing Over Variant Experts), an adaptive framework that routes each example to SFT or RL based on the structural topology of its reasoning trace. GROVE parses each trace into a Reasoning Tree, scores its complexity via graph entropy, and partitions the corpus through a data-driven Gaussian Mixture Model with no hand-tuned threshold. Low-complexity traces are trained with SFT and high-complexity traces with GRPO as parallel LoRA adapters from a shared frozen base, merged into a single deployable model with no inference-time overhead. Across two training corpora and five reasoning benchmarks, GROVE consistently outperforms single-stage and naive-hybrid baselines, and a reversed-routing ablation confirms that this mapping is intrinsic rather than arbitrary.
Anthology ID:
2026.findings-emnlp.1332
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
28210–28224
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1332/
DOI:
10.18653/2026.findings-emnlp.1332
Bibkey:
Cite (ACL):
Yiming Luo, Chunlin Tian, and Li Li. 2026. GROVE: Graph-based Routing Over Variant Experts for Adaptive Two-Stage Training of Reasoning Models. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 28210–28224, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
GROVE: Graph-based Routing Over Variant Experts for Adaptive Two-Stage Training of Reasoning Models (Luo et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1332.pdf