AgentCollab: A Self-Evaluation-Driven Collaboration Paradigm for Efficient LLM Agents

Wenbo Gao, Renxi Liu, Xian Wang, Guo Fang, Shuai Yang, Chen xi, Hui-Ling Zhen, Hanting Chen, Weizhe Lin, Xiaosong Li, Yaoyuan Wang


Abstract
Autonomous agents powered by large language models (LLMs) perform complex tasks through long-horizon reasoning and tool interaction, where a fundamental trade-off arises between execution efficiency and reasoning robustness. Models at different capability–cost levels offer complementary advantages: lower-cost models enable fast execution but may struggle on difficult reasoning segments, while stronger models provide more robust reasoning at higher computational cost. We present AgentCollab, a self-driven collaborative inference framework that dynamically coordinates models with different reasoning capacities during agent execution. Instead of relying on external routing modules, the framework uses the agent’s own self-reflection signal to determine whether the current reasoning trajectory is making meaningful progress, and escalates control to a stronger reasoning tier only when necessary. To further stabilize long-horizon execution, we introduce a difficulty-aware cumulative escalation strategy that allocates additional reasoning budget based on recent failure signals. In our experiments, we instantiate this framework using a two-level small–large model setting. Experiments on diverse multi-step agent benchmarks show that AgentCollab consistently improves the accuracy–efficiency Pareto frontier of LLM agents.
Anthology ID:
2026.emnlp-main.2400
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
54555–54570
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2400/
DOI:
Bibkey:
Cite (ACL):
Wenbo Gao, Renxi Liu, Xian Wang, Guo Fang, Shuai Yang, Chen xi, Hui-Ling Zhen, Hanting Chen, Weizhe Lin, Xiaosong Li, and Yaoyuan Wang. 2026. AgentCollab: A Self-Evaluation-Driven Collaboration Paradigm for Efficient LLM Agents. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 54555–54570, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
AgentCollab: A Self-Evaluation-Driven Collaboration Paradigm for Efficient LLM Agents (Gao et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2400.pdf