Semantic role labeling tools for biomedical question answering: a study of selected tools on the BioASQ datasets

Fabian Eckert, Mariana Neves


Abstract
Question answering (QA) systems usually rely on advanced natural language processing components to precisely understand the questions and extract the answers. Semantic role labeling (SRL) is known to boost performance for QA, but its use for biomedical texts has not yet been fully studied. We analyzed the performance of three SRL tools (BioKIT, BIOSMILE and PathLSTM) on 1776 questions from the BioASQ challenge. We compared the systems regarding the coverage of the questions and snippets, as well as based on pre-defined criteria, such as easiness of installation, supported formats and usability. Finally, we integrated two of the tools in a simple QA system to further evaluate their performance over the official BioASQ test sets.
Anthology ID:
W18-5302
Volume:
Proceedings of the 6th BioASQ Workshop A challenge on large-scale biomedical semantic indexing and question answering
Month:
November
Year:
2018
Address:
Brussels, Belgium
Editors:
Ioannis A. Kakadiaris, George Paliouras, Anastasia Krithara
Venue:
BioASQ
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
11–21
Language:
URL:
https://aclanthology.org/W18-5302
DOI:
10.18653/v1/W18-5302
Bibkey:
Cite (ACL):
Fabian Eckert and Mariana Neves. 2018. Semantic role labeling tools for biomedical question answering: a study of selected tools on the BioASQ datasets. In Proceedings of the 6th BioASQ Workshop A challenge on large-scale biomedical semantic indexing and question answering, pages 11–21, Brussels, Belgium. Association for Computational Linguistics.
Cite (Informal):
Semantic role labeling tools for biomedical question answering: a study of selected tools on the BioASQ datasets (Eckert & Neves, BioASQ 2018)
Copy Citation:
PDF:
https://aclanthology.org/W18-5302.pdf