OrchDebate: Adaptive Orchestration for Multi-Agent Debate via Self-Evolving Skills

Kaiyu Zhou, Yongsen Zheng, Xuanye Zhang, Kwok-Yan Lam


Abstract
Multi-Agent Debate (MAD) has emerged as a promising paradigm for eliciting stronger inference-time reasoning, yet most existing systems still use fixed interaction protocols across instances. Such static designs can suffer from anchoring bias, overthinking on easy problems, and rigid coordination across tasks of varying difficulty. We present OrchDebate, a framework that recasts multi-agent debate as structured-state orchestration over reusable debate-control skills. Instead of following a pre-defined template, OrchDebate uses an orchestrator to examine the current debate state and select the next coordination action, such as introducing agents under different visibility settings or terminating deliberation with an adaptive readout rule. This skill-based view makes debate control modular and state-dependent. The orchestrator operates through a structured control interface rather than directly generating reasoning content, helping reduce reliance on early answers. OrchDebate further maintains a self-evolving skill bank whose reusable realizations are refined through outcome-guided updates on an evolution stream, without additional external training data. Across diverse benchmarks, OrchDebate delivers a better accuracy-cost trade-off than representative fixed and adaptive debate methods by allocating debate compute more selectively.
Anthology ID:
2026.emnlp-main.2078
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
47331–47350
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2078/
DOI:
Bibkey:
Cite (ACL):
Kaiyu Zhou, Yongsen Zheng, Xuanye Zhang, and Kwok-Yan Lam. 2026. OrchDebate: Adaptive Orchestration for Multi-Agent Debate via Self-Evolving Skills. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 47331–47350, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
OrchDebate: Adaptive Orchestration for Multi-Agent Debate via Self-Evolving Skills (Zhou et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2078.pdf