PIE-QG: Paraphrased Information Extraction for Unsupervised Question Generation from Small Corpora

Dinesh Nagumothu, Bahadorreza Ofoghi, Guangyan Huang, Peter Eklund


Abstract
Supervised Question Answering systems (QA systems) rely on domain-specific human-labeled data for training. Unsupervised QA systems generate their own question-answer training pairs, typically using secondary knowledge sources to achieve this outcome. Our approach (called PIE-QG) uses Open Information Extraction (OpenIE) to generate synthetic training questions from paraphrased passages and uses the question-answer pairs as training data for a language model for a state-of-the-art QA system based on BERT. Triples in the form of <subject, predicate, object> are extracted from each passage, and questions are formed with subjects (or objects) and predicates while objects (or subjects) are considered as answers. Experimenting on five extractive QA datasets demonstrates that our technique achieves on-par performance with existing state-of-the-art QA systems with the benefit of being trained on an order of magnitude fewer documents and without any recourse to external reference data sources.
Anthology ID:
2022.conll-1.24
Volume:
Proceedings of the 26th Conference on Computational Natural Language Learning (CoNLL)
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates (Hybrid)
Editors:
Antske Fokkens, Vivek Srikumar
Venue:
CoNLL
SIG:
SIGNLL
Publisher:
Association for Computational Linguistics
Note:
Pages:
350–359
Language:
URL:
https://aclanthology.org/2022.conll-1.24
DOI:
10.18653/v1/2022.conll-1.24
Bibkey:
Cite (ACL):
Dinesh Nagumothu, Bahadorreza Ofoghi, Guangyan Huang, and Peter Eklund. 2022. PIE-QG: Paraphrased Information Extraction for Unsupervised Question Generation from Small Corpora. In Proceedings of the 26th Conference on Computational Natural Language Learning (CoNLL), pages 350–359, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
Cite (Informal):
PIE-QG: Paraphrased Information Extraction for Unsupervised Question Generation from Small Corpora (Nagumothu et al., CoNLL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.conll-1.24.pdf
Software:
 2022.conll-1.24.software.zip