Automatic True/False Question Generation for Educational Purpose

Bowei Zou, Pengfei Li, Liangming Pan, Ai Ti Aw


Abstract
In field of teaching, true/false questioning is an important educational method for assessing students’ general understanding of learning materials. Manually creating such questions requires extensive human effort and expert knowledge. Question Generation (QG) technique offers the possibility to automatically generate a large number of questions. However, there is limited work on automatic true/false question generation due to the lack of training data and difficulty finding question-worthy content. In this paper, we propose an unsupervised True/False Question Generation approach (TF-QG) that automatically generates true/false questions from a given passage for reading comprehension test. TF-QG consists of a template-based framework that aims to test the specific knowledge in the passage by leveraging various NLP techniques, and a generative framework to generate more flexible and complicated questions by using a novel masking-and-infilling strategy. Human evaluation shows that our approach can generate high-quality and valuable true/false questions. In addition, simulated testing on the generated questions challenges the state-of-the-art inference models from NLI, QA, and fact verification tasks.
Anthology ID:
2022.bea-1.10
Volume:
Proceedings of the 17th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2022)
Month:
July
Year:
2022
Address:
Seattle, Washington
Editors:
Ekaterina Kochmar, Jill Burstein, Andrea Horbach, Ronja Laarmann-Quante, Nitin Madnani, Anaïs Tack, Victoria Yaneva, Zheng Yuan, Torsten Zesch
Venue:
BEA
SIG:
SIGEDU
Publisher:
Association for Computational Linguistics
Note:
Pages:
61–70
Language:
URL:
https://aclanthology.org/2022.bea-1.10
DOI:
10.18653/v1/2022.bea-1.10
Bibkey:
Cite (ACL):
Bowei Zou, Pengfei Li, Liangming Pan, and Ai Ti Aw. 2022. Automatic True/False Question Generation for Educational Purpose. In Proceedings of the 17th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2022), pages 61–70, Seattle, Washington. Association for Computational Linguistics.
Cite (Informal):
Automatic True/False Question Generation for Educational Purpose (Zou et al., BEA 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.bea-1.10.pdf
Video:
 https://aclanthology.org/2022.bea-1.10.mp4
Data
FEVER