LEAF: Growing Trees Without Branching for Speech-Aware Large Language Model Post-Training

Argyrios Gerogiannis, Yekaterina Yegorova, Mark A. Hasegawa-Johnson, Venugopal Veeravalli


Abstract
State-of-the-art GRPO-style methods for speech-aware large language model post-training suffer from coarse credit assignment, broadcasting the same terminal-reward advantage to every token in a response. This ignores useful structure within rollout batches, where speech-conditioned completions often share prefixes before diverging at important decisions. We propose Low-rank Exploration with Adaptive Forking (LEAF), a retrospective tree-based RL method that recovers this structure without online branching or additional decoding. LEAF samples complete responses, selects high-surprisal boundaries, groups responses by shared prefixes, and assigns span-level advantages using descendant rewards. We theoretically justify LEAF’s span-level credit assignment and boundary-selection design. Empirically, LEAF improves over GRPO across speech question answering and speech translation benchmarks under the same rollout and low-rank adaptation budget. Notably, smaller LEAF-trained models consistently outperform current state-of-art, full-parameter baselines.
Anthology ID:
2026.findings-emnlp.1327
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
28125–28140
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1327/
DOI:
Bibkey:
Cite (ACL):
Argyrios Gerogiannis, Yekaterina Yegorova, Mark A. Hasegawa-Johnson, and Venugopal Veeravalli. 2026. LEAF: Growing Trees Without Branching for Speech-Aware Large Language Model Post-Training. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 28125–28140, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
LEAF: Growing Trees Without Branching for Speech-Aware Large Language Model Post-Training (Gerogiannis et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1327.pdf