Vouch: Counterfactual Contracts for Multi-Agent Coordination

Abhay Bhandarkar, Vedanth Nanesha


Abstract
Multi-agent LLM coordination typically reduces to voting or arbitration over self-reported labels and reasoning that is uncoupled from agent behavior and fails predictably under structured bias. A shortcut-reliant agent is confident about its shortcut, and its predictions survive any rule that consults only self-reports. We propose VOUCH, a coordination protocol in which every agent claim is coupled to a deterministic test the protocol runs itself. An agent commits to a counterfactual prediction about an intervention’s outcome; the protocol applies the intervention and verifies the contract only if the actual outcome matches. The natural single-side instantiation is unsound as a self-coherent agent satisfies its own commitment by construction. We resolve this with a dual-side construction where the proposer additionally commits to a second agent’s post-intervention prediction, a cross-side claim that self-coherence cannot fulfill. Across multimodal classification (Hateful Memes, CrisisMMD, MM-IMDb), code (MBPP, HumanEval), and math (GSM8K, MATH, SVAMP), the dual-side fix reduces wrong-verified events by 46%–85% per domain while never falling more than 1 point below the Ensemble baseline on accuracy. VOUCH is therefore designed not to outperform ensembling, but to preserve task accuracy while making coordination decisions testable and auditable.
Anthology ID:
2026.findings-aacl.222
Volume:
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4345–4368
Language:
URL:
https://aclanthology.org/2026.findings-aacl.222/
DOI:
Bibkey:
Cite (ACL):
Abhay Bhandarkar and Vedanth Nanesha. 2026. Vouch: Counterfactual Contracts for Multi-Agent Coordination. In Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026, pages 4345–4368, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
Vouch: Counterfactual Contracts for Multi-Agent Coordination (Bhandarkar & Nanesha, Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-aacl.222.pdf