Dude: A Dual-Detection Multi-Agent System for Paper-Code Discrepancy Detection

Weijie Liu, Running Zhao, Wenhao Yuan, Jinfeng Xu, Zhanfeng Xu, Xiaoxi Zhang, Edith Cheuk-Han Ngai


Abstract
LLM-empowered paper-code discrepancy detection has received growing concern since the scaling of research submissions exceeds the manual review capability. However, the limited context capacity and one-sided discrepancy detection of existing single-agent LLM paradigms lead to an inferior recall performance in detecting discrepancies. In this paper, we propose **Dude**, the first **Du**al-**De**tection Multi-Agent System for paper-code discrepancy detection. We discover that the granularity asymmetry of the paper-language and code-language introduces over-interpretation and over-reporting challenges in a multi-agent system design for discrepancy detection, resulting in increasing false positives. To address this, we propose a granularity-aligned negotiation and a two-stage salience-filtering mechanism in Dude, which effectively prevents agents from falsely reporting discrepancies. Experimental results in real-world paper-code discrepancy datasets showcase Dude’s significant recall and precision improvement by up to **22.8%**, increasing F1 score by up to **18.7%** compared to baseline methods.
Anthology ID:
2026.emnlp-main.1017
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
23371–23389
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1017/
DOI:
Bibkey:
Cite (ACL):
Weijie Liu, Running Zhao, Wenhao Yuan, Jinfeng Xu, Zhanfeng Xu, Xiaoxi Zhang, and Edith Cheuk-Han Ngai. 2026. Dude: A Dual-Detection Multi-Agent System for Paper-Code Discrepancy Detection. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 23371–23389, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Dude: A Dual-Detection Multi-Agent System for Paper-Code Discrepancy Detection (Liu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1017.pdf