Enhancing Factuality and Transparency in Generative Models for Biomedical Question Answering

Ankita Behura, Siting Liang, Daniel Sonntag


Abstract
Biomedical Question Answering (BQA) systems are vital for providing clinicians and researchers with efficient access to large amount of biomedical scientific studies. Existing automated BQA models, however, often rely on complex hybrid architectures to handle diverse question and answer formats, leading to inefficiency and high complexity. While domain-specific generative language models like BioBART offer a unified and simplified alternative capable of producing fluent human-like responses, they are prone to hallucination and lack interpretability, undermining their trustworthiness in critical healthcare domains. To address these limitations, this work introduces an enhanced model that augments BioBART with a pointer network for accurate token copying and a novel Keyphrase Filter (KPF) to guide attention toward critical information during generation. Experimental results on the BioASQ challenge demonstrate that the proposed Pointer-KPF model significantly outperforms the baseline BioBART, particularly on metrics for ideal answers. Furthermore, our evaluation shows that the model enhances transparency: pointer-guided attention heatmaps reveal improved input-output alignment, while keyphrase scores act as saliency maps to identify the most influential input segments. This approach not only reduces hallucination by strengthening textual grounding but also provides crucial insights into the model’s reasoning, thereby increasing confidence and trust in its outputs.
Anthology ID:
2026.nslp-1.13
Volume:
Proceedings of Natural Scientific Language Processing (NSLP) @ LREC 2026
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Georg Rehm, Stefan Dietze, Danilo Dessi, Diana Maynard, Sonja Schimmler
Venues:
NSLP | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
127–139
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-nslp-13
DOI:
10.63317/3uxg7miycis4
Bibkey:
Cite (ACL):
Ankita Behura, Siting Liang, and Daniel Sonntag. 2026. Enhancing Factuality and Transparency in Generative Models for Biomedical Question Answering. In Proceedings of Natural Scientific Language Processing (NSLP) @ LREC 2026, pages 127–139, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
Enhancing Factuality and Transparency in Generative Models for Biomedical Question Answering (Behura et al., NSLP 2026)
Copy Citation: