HRCA+: Advanced Multiple-choice Machine Reading Comprehension Method

Yuxiang Zhang, Hayato Yamana


Abstract
Multiple-choice question answering (MCQA) for machine reading comprehension (MRC) is challenging. It requires a model to select a correct answer from several candidate options related to text passages or dialogue. To select the correct answer, such models must have the ability to understand natural languages, comprehend textual representations, and infer the relationship between candidate options, questions, and passages. Previous models calculated representations between passages and question-option pairs separately, thereby ignoring the effect of other relation-pairs. In this study, we propose a human reading comprehension attention (HRCA) model and a passage-question-option (PQO) matrix-guided HRCA model called HRCA+ to increase accuracy. The HRCA model updates the information learned from the previous relation-pair to the next relation-pair. HRCA+ utilizes the textual information and the interior relationship between every two parts in a passage, a question, and the corresponding candidate options. Our proposed method outperforms other state-of-the-art methods. On the Semeval-2018 Task 11 dataset, our proposed method improved accuracy levels from 95.8% to 97.2%, and on the DREAM dataset, it improved accuracy levels from 90.4% to 91.6% without extra training data, from 91.8% to 92.6% with extra training data.
Anthology ID:
2022.lrec-1.651
Volume:
Proceedings of the Thirteenth Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
6059–6068
Language:
URL:
https://aclanthology.org/2022.lrec-1.651
DOI:
Bibkey:
Cite (ACL):
Yuxiang Zhang and Hayato Yamana. 2022. HRCA+: Advanced Multiple-choice Machine Reading Comprehension Method. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 6059–6068, Marseille, France. European Language Resources Association.
Cite (Informal):
HRCA+: Advanced Multiple-choice Machine Reading Comprehension Method (Zhang & Yamana, LREC 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.lrec-1.651.pdf
Data
DREAMMCTest