FUSE: Failure-Guided Scenario Synthesis and Weighted Refinement for LLM Function Calling

Zhiguo Tao, Linhan Li, Lifan Sun, Zichen Yuan


Abstract
Large language model (LLM) agents increasingly rely on function calling to act across multi-turn interactions, but compact models remain brittle when tool availability, required parameters, and dialogue constraints change over time. Existing synthetic tool-use data often broadens coverage without targeting the recurring failures of a specific model. We present FUSE, a failure-guided refinement approach that uses the model’s own function-calling errors to synthesize harder training scenarios and then emphasizes difficult examples during supervised fine-tuning. This data-centric design turns diagnostic failures into targeted training signal while remaining simple to apply with standard offline fine-tuning. Experiments on BFCLv3 show that FUSE substantially improves a compact Qwen3-based model across standard and stress categories, including missing functions, missing parameters, and long-context interactions. Evaluation on BFCLv4 provides initial evidence that the same refinement strategy can transfer to selected agentic function-calling tasks.
Anthology ID:
2026.realm-1.13
Volume:
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Ehsan Kamalloo, Nicolas Gontier, Nikolai Rozanov, Maryam Hashemzadeh, Akhil Arora
Venues:
REALM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
177–186
Language:
URL:
https://aclanthology.org/2026.realm-1.13/
DOI:
Bibkey:
Cite (ACL):
Zhiguo Tao, Linhan Li, Lifan Sun, and Zichen Yuan. 2026. FUSE: Failure-Guided Scenario Synthesis and Weighted Refinement for LLM Function Calling. In Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026), pages 177–186, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
FUSE: Failure-Guided Scenario Synthesis and Weighted Refinement for LLM Function Calling (Tao et al., REALM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.realm-1.13.pdf