Unsupervised Multiple Choices Question Answering: Start Learning from Basic Knowledge

Chi-Liang Liu, Hung-yi Lee


Abstract
In this paper, we study the possibility of unsupervised Multiple Choices Question Answering (MCQA). From very basic knowledge, the MCQA model knows that some choices have higher probabilities of being correct than others. The information, though very noisy, guides the training of an MCQA model. The proposed method is shown to outperform the baseline approaches on RACE and is even comparable with some supervised learning approaches on MC500.
Anthology ID:
2021.mrqa-1.12
Volume:
Proceedings of the 3rd Workshop on Machine Reading for Question Answering
Month:
November
Year:
2021
Address:
Punta Cana, Dominican Republic
Editors:
Adam Fisch, Alon Talmor, Danqi Chen, Eunsol Choi, Minjoon Seo, Patrick Lewis, Robin Jia, Sewon Min
Venue:
MRQA
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
113–118
Language:
URL:
https://aclanthology.org/2021.mrqa-1.12
DOI:
10.18653/v1/2021.mrqa-1.12
Bibkey:
Cite (ACL):
Chi-Liang Liu and Hung-yi Lee. 2021. Unsupervised Multiple Choices Question Answering: Start Learning from Basic Knowledge. In Proceedings of the 3rd Workshop on Machine Reading for Question Answering, pages 113–118, Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Unsupervised Multiple Choices Question Answering: Start Learning from Basic Knowledge (Liu & Lee, MRQA 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.mrqa-1.12.pdf
Code
 additional community code
Data
MCTestRACESQuAD