MedEvi-NS at ArchEHR-QA 2026: Using Clinical Reasoning Principles to Improve Zero-shot Capabilities of Large Language Models in Evidence Alignment

Mengxuan Sun, Nicolay Rusnachenko


Abstract
The ArchEHR-QA shared task focuses on grounded question answering using patient EHR data. For the given clinical interpretation of the patient question, note excerpt (E) and answer text (A), subtask 4 (evidence alignment) aims to cite supporting sentences from E for each sentence in A. In this paper, we propose a prompt-engineering methodology that features clinical-reasoning principles in related alignment. We adopt this methodology for GPT-5.2 in zero-shot learning mode. According to our experiments on ArchEHR-QA, incorporating clinical reasoning principles into the prompt improves F 1overall by +2.0%. Our final submission resulted in 77.4% by F 1overall, which positions us at 10th out of 16 teams. Our code is publicly available: https://github.com/nicolay-r/ArchEHR-QA-2026-Task-4-MedEvi-NS
Anthology ID:
2026.cl4health-1.44
Volume:
Proceedings of the Third Workshop on Patient-Oriented Language Processing (CL4Health) @ LREC 2026
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Deepak Gupta, Paul Thompson, Sophia Ananiadou, Dina Demner-Fushman
Venues:
CL4Health | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
482–486
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-cl4health-44
DOI:
10.63317/2uoe94adhkng
Bibkey:
Cite (ACL):
Mengxuan Sun and Nicolay Rusnachenko. 2026. MedEvi-NS at ArchEHR-QA 2026: Using Clinical Reasoning Principles to Improve Zero-shot Capabilities of Large Language Models in Evidence Alignment. In Proceedings of the Third Workshop on Patient-Oriented Language Processing (CL4Health) @ LREC 2026, pages 482–486, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
MedEvi-NS at ArchEHR-QA 2026: Using Clinical Reasoning Principles to Improve Zero-shot Capabilities of Large Language Models in Evidence Alignment (Sun & Rusnachenko, CL4Health 2026)
Copy Citation: