Asking the Right Questions: Ontology-Grounded Interpretable Embeddings for Biomedical Text

Yixuan Tang, Zhenghong Lin, Yandong Sun, Wynne Hsu, Mong-Li Lee, Anthony Kum Hoe Tung


Abstract
While dense biomedical embeddings achieve strong performance, their opaque dimensions limit transparency in biomedical NLP. Recent question-based interpretable embeddings represent text through binary answers to natural-language questions, but existing approaches rely primarily on corpus-driven signals, often capturing topical or stylistic differences rather than fine-grained biomedical distinctions. We propose QIME, an ontology-grounded framework for interpretable biomedical text embeddings in which each dimension corresponds to an explicit biomedical-domain yes/no question. QIME leverages a biomedical ontology to guide contrastive question generation from semantic clusters, producing atomic, domain-grounded questions. It constructs embeddings via similarity-based semantic activation with MMR-based diversity-aware dimension selection, yielding sparse representations efficiently. Experiments on biomedical clustering, STS and retrieval benchmarks show that QIME consistently outperforms prior interpretable embedding methods and substantially narrows the gap to strong black-box biomedical encoders. It also imposes substantially lower cognitive burden than existing methods, providing concise and domain-specific interpretations. The code is available at https://github.com/L1nzh/QIME.
Anthology ID:
2026.findings-emnlp.1149
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
24332–24344
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1149/
DOI:
Bibkey:
Cite (ACL):
Yixuan Tang, Zhenghong Lin, Yandong Sun, Wynne Hsu, Mong-Li Lee, and Anthony Kum Hoe Tung. 2026. Asking the Right Questions: Ontology-Grounded Interpretable Embeddings for Biomedical Text. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 24332–24344, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Asking the Right Questions: Ontology-Grounded Interpretable Embeddings for Biomedical Text (Tang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1149.pdf