Razreshili at ArchEHR-QA 2026: Evidence Alignment via LLM Prompting and Cross-Encoder Fine-tuning

Arina Zemchyk


Abstract
We describe our system for Subtask 4 (Evidence Alignment) of the ArchEHR-QA 2026 shared task, which requires aligning each sentence of a clinician-authored answer to the supporting sentence(s) in a clinical note excerpt derived from MIMIC. The task is challenging due to many-to-many alignment structure, answer sentences with no note support, and the semantic gap between clinical note language and answer paraphrases. We explore two approaches: few-shot chain-of-thought prompting with Qwen2.5-7B-Instruct and LoRA fine-tuning of a cross-encoder with combined InfoNCE and BCE loss. Our best system achieves a micro F1 of 67.93 on the test set.
Anthology ID:
2026.cl4health-1.49
Volume:
Proceedings of the Third Workshop on Patient-Oriented Language Processing (CL4Health) @ LREC 2026
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Deepak Gupta, Paul Thompson, Sophia Ananiadou, Dina Demner-Fushman
Venues:
CL4Health | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
524–529
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-cl4health-49
DOI:
10.63317/5mop8iu8k9ej
Bibkey:
Cite (ACL):
Arina Zemchyk. 2026. Razreshili at ArchEHR-QA 2026: Evidence Alignment via LLM Prompting and Cross-Encoder Fine-tuning. In Proceedings of the Third Workshop on Patient-Oriented Language Processing (CL4Health) @ LREC 2026, pages 524–529, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
Razreshili at ArchEHR-QA 2026: Evidence Alignment via LLM Prompting and Cross-Encoder Fine-tuning (Zemchyk, CL4Health 2026)
Copy Citation: