Externalizing Requirement-to-Repair Artifacts as Observable Traces for LLM-Based Program Repair

Zewen Tao, Shin-nosuke Ishikawa


Abstract
Repository-level repair requires not only correct patches but also inspectable records that explain how issue requirements are translated into code changes and post-edit evidence. We contribute THEMIS, a stage-aware repair workflow that externalizes this requirement-to-repair process through semantic interpretation, a runtime requirement–code graph, graph-derived Developer guidance, retained repair rationale and patches, and post-edit audit records. A retrospective audit of 300 SWE-bench Lite cases demonstrates that these artifacts provide broad support for cross-stage inspection: a complete Developer rationale is available for 288 cases, and 214 cases (71.3%) retain a complete audited field set connecting the selected stages. The retained records further enable systematic measurement of cross-stage correspondence: target symbols recur in 62.6% of Developer rationales and in 62.8% of patches, rising to 75.8% when related symbols are included. In a paired 100-case comparison, the relational workflow resolves 19 cases versus 9 for the direct same-input condition, corresponding to a 10-percentage-point improvement. Together, these results show that THEMIS turns otherwise implicit requirement-to-repair transitions into observable traces, enabling systematic inspection of how repair decisions persist, align, and evolve across stages.
Anthology ID:
2026.realm-1.30
Volume:
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Ehsan Kamalloo, Nicolas Gontier, Nikolai Rozanov, Maryam Hashemzadeh, Akhil Arora
Venues:
REALM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
451–460
Language:
URL:
https://aclanthology.org/2026.realm-1.30/
DOI:
Bibkey:
Cite (ACL):
Zewen Tao and Shin-nosuke Ishikawa. 2026. Externalizing Requirement-to-Repair Artifacts as Observable Traces for LLM-Based Program Repair. In Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026), pages 451–460, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Externalizing Requirement-to-Repair Artifacts as Observable Traces for LLM-Based Program Repair (Tao & Ishikawa, REALM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.realm-1.30.pdf