TopoCurate: Modeling Interaction Topology for Tool-Use Agent Training

Jinluan Yang, Yuxin Liu, Zhengyu Chen, Chengcheng Han, Yueqing Sun, Xierui Song, Hui Su, Xunliang Cai, Fei Wu, Kun Kuang


Abstract
Training tool-use agents typically relies on outcome-based filtering: Supervised Fine-Tuning (SFT) on successful trajectories and Reinforcement Learning (RL) on pass-rate-selected tasks. However, this paradigm ignores interaction dynamics—successful trajectories may lack error recovery or exhibit redundancy, while pass rates fail to distinguish structurally informative tasks from trivial ones. To bridge this gap, we propose TopoCurate, an interaction-aware framework that shifts the paradigm from linear outcome filtering to topological interaction modeling. By projecting multi-trial rollouts into a unified semantic quotient topology within the same task, we construct a structured manifold that explicitly captures the divergence between success and failure pathways across tool invocations and environmental responses. Leveraging this representation, we introduce a dual-selection mechanism: for SFT, we prioritize trajectories demonstrating reflective recovery, semantic efficiency, and strategic diversity to mitigate covariate shift and mode collapse; for RL, we select tasks with high error branch ratios and strategic heterogeneity, maximizing gradient Signal-to-Noise Ratio to address vanishing signals in sparse-reward settings. Evaluations on BFCLv3 and Tau2 Bench show that TopoCurate achieves consistent gains of 4.2% (SFT) and 6.9% (RL) over state-of-the-art baselines.
Anthology ID:
2026.findings-emnlp.1969
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
41986–42006
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1969/
DOI:
Bibkey:
Cite (ACL):
Jinluan Yang, Yuxin Liu, Zhengyu Chen, Chengcheng Han, Yueqing Sun, Xierui Song, Hui Su, Xunliang Cai, Fei Wu, and Kun Kuang. 2026. TopoCurate: Modeling Interaction Topology for Tool-Use Agent Training. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 41986–42006, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
TopoCurate: Modeling Interaction Topology for Tool-Use Agent Training (Yang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1969.pdf