Meta-Moderator: Empowering Multi-Agent Debate with Meta-Cognition

Wentao Hu, Zhuoyue Wan, Jinhao Shen, Chen Jason Zhang, Xiao-Yong Wei, Li Qing


Abstract
Multi-agent debate can improve large language model reasoning by eliciting diverse hypotheses and critiques, yet its performance is often constrained by weak moderation. Common pipelines rely on fixed budgets, agreement-based stopping, or untrained judges, leading to redundant deliberation and unreliable evidence aggregation. We cast moderation as a meta-cognitive process, monitoring debate utility, controlling deliberation, and adjudicating a final answer, and introduce Meta-Moderator, a learnable framework that dynamically regulates debate and decides when to finalize an answer. Meta-Moderator is trained independently of the debaters via outcome-driven policy optimization, making debate regulation an explicit capability rather than an incidental effect of prompting. Across five benchmarks, Meta-Moderator outperforms widely used decision layers and transfers across tasks and system configurations. Further analyses show that it allocates debate more selectively and reduces mis-aggregation after informative hypotheses appear.
Anthology ID:
2026.findings-emnlp.1250
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
26435–26451
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1250/
DOI:
Bibkey:
Cite (ACL):
Wentao Hu, Zhuoyue Wan, Jinhao Shen, Chen Jason Zhang, Xiao-Yong Wei, and Li Qing. 2026. Meta-Moderator: Empowering Multi-Agent Debate with Meta-Cognition. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 26435–26451, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Meta-Moderator: Empowering Multi-Agent Debate with Meta-Cognition (Hu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1250.pdf