Denoising Distantly Supervised Open-Domain Question Answering

Yankai Lin, Haozhe Ji, Zhiyuan Liu, Maosong Sun


Abstract
Distantly supervised open-domain question answering (DS-QA) aims to find answers in collections of unlabeled text. Existing DS-QA models usually retrieve related paragraphs from a large-scale corpus and apply reading comprehension technique to extract answers from the most relevant paragraph. They ignore the rich information contained in other paragraphs. Moreover, distant supervision data inevitably accompanies with the wrong labeling problem, and these noisy data will substantially degrade the performance of DS-QA. To address these issues, we propose a novel DS-QA model which employs a paragraph selector to filter out those noisy paragraphs and a paragraph reader to extract the correct answer from those denoised paragraphs. Experimental results on real-world datasets show that our model can capture useful information from noisy data and achieve significant improvements on DS-QA as compared to all baselines.
Anthology ID:
P18-1161
Volume:
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2018
Address:
Melbourne, Australia
Editors:
Iryna Gurevych, Yusuke Miyao
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1736–1745
Language:
URL:
https://aclanthology.org/P18-1161
DOI:
10.18653/v1/P18-1161
Bibkey:
Cite (ACL):
Yankai Lin, Haozhe Ji, Zhiyuan Liu, and Maosong Sun. 2018. Denoising Distantly Supervised Open-Domain Question Answering. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1736–1745, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
Denoising Distantly Supervised Open-Domain Question Answering (Lin et al., ACL 2018)
Copy Citation:
PDF:
https://aclanthology.org/P18-1161.pdf
Poster:
 P18-1161.Poster.pdf
Code
 thunlp/OpenQA
Data
QUASARQUASAR-TSearchQATriviaQAWebQuestions