ReproAgent: Contract-Guided Paper-to-Code Reproduction

Xue Hu, Pan Zewei, Zhongyuan Wang, Zhou Liu, Zeli Su, Wentao Zhang


Abstract
Paper-to-code reproduction asks scientific AI agents to turn research papers into executable repositories that preserve the paper’s method, protocol and artifacts. This is difficult because the specification is split: explicit paper content such as algorithms, metrics and artifacts is often lost across long agent trajectories, while implicit details such as framework defaults and conventions inherited from related work are absent from the paper. We introduce ReproAgent a four-stage Prepare–Plan–Generate–Repair pipeline built around a persistent implementation contract with two channels: an implementation-requirement channel that turns paper snippets into code obligations, and a reference-evidence channel that retrieves content and structure evidence from related repositories. Both are bound to work packages, projected into file-level contracts, and consumed across generation and repair. On PaperBench Code-Dev, ReproAgent reaches the highest mean score among same-backbone scaffolds under both Claude-Sonnet-4.5 and Gemini-3-Flash. End-to-end channel ablations and per-paper cases support the contribution of both channels.Code and experimental artifacts are publicly available at https://anonymous.4open.science/r/ReproAgent-E760.
Anthology ID:
2026.findings-emnlp.175
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
3681–3702
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.175/
DOI:
Bibkey:
Cite (ACL):
Xue Hu, Pan Zewei, Zhongyuan Wang, Zhou Liu, Zeli Su, and Wentao Zhang. 2026. ReproAgent: Contract-Guided Paper-to-Code Reproduction. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 3681–3702, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ReproAgent: Contract-Guided Paper-to-Code Reproduction (Hu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.175.pdf