HiTZ-IXA at ArchEHR-QA 2026: Evidence Alignment Through Self-Consistency and Prompt Curation in Memory-Constrained Environments

Xabier Irastortza-Urbieta, Maite Oronoz, Alicia Pérez


Abstract
The development of question-answering systems capable of grounding their answers in Electronic Health Records could provide patients with faithful assistance while reducing the clinical workload. The ArchEHR-QA 2026 Shared Task was organized to advance progress in this context. In this paper, we present our strategies for addressing this shared task, which are focused primarily on evidence alignment and, to a lesser extent, on evidence identification. Our approaches rely exclusively on open-source models with up to 8 billion parameters, aiming to produce systems suitable for environments with memory constraints. We experimented with methods based on embedding models, prompt curation, self-consistency, and combination of LLMs. We concluded that prompt curation together with an effective post-processing step was crucial for creating stable systems, while self-consistency yielded considerable gains in performance. The results of our approaches suggest that small LLMs can substantially improve their accuracy in the evidence alignment task via simple and affordable techniques.
Anthology ID:
2026.cl4health-1.40
Volume:
Proceedings of the Third Workshop on Patient-Oriented Language Processing (CL4Health) @ LREC 2026
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Deepak Gupta, Paul Thompson, Sophia Ananiadou, Dina Demner-Fushman
Venues:
CL4Health | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
434–440
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-cl4health-40
DOI:
10.63317/3zuhjyhh6vy9
Bibkey:
Cite (ACL):
Xabier Irastortza-Urbieta, Maite Oronoz, and Alicia Pérez. 2026. HiTZ-IXA at ArchEHR-QA 2026: Evidence Alignment Through Self-Consistency and Prompt Curation in Memory-Constrained Environments. In Proceedings of the Third Workshop on Patient-Oriented Language Processing (CL4Health) @ LREC 2026, pages 434–440, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
HiTZ-IXA at ArchEHR-QA 2026: Evidence Alignment Through Self-Consistency and Prompt Curation in Memory-Constrained Environments (Irastortza-Urbieta et al., CL4Health 2026)
Copy Citation: