Unsupervised Generation of Long-form Technical Questions from Textbook Metadata using Structured Templates

Indrajit Bhattacharya, Subhasish Ghosh, Arpita Kundu, Pratik Saini, Tapas Nayak


Abstract
We explore the task of generating long-form technical questions from textbooks. Semi-structured metadata of a textbook — the table of contents and the index — provide rich cues for technical question generation. Existing literature for long-form question generation focuses mostly on reading comprehension assessment, and does not use semi-structured metadata for question generation. We design unsupervised template based algorithms for generating questions based on structural and contextual patterns in the index and ToC. We evaluate our approach on textbooks on diverse subjects and show that our approach generates high quality questions of diverse types. We show that, in comparison, zero-shot question generation using pre-trained LLMs on the same meta-data has much poorer quality.
Anthology ID:
2022.pandl-1.3
Volume:
Proceedings of the First Workshop on Pattern-based Approaches to NLP in the Age of Deep Learning
Month:
October
Year:
2022
Address:
Gyeongju, Republic of Korea
Editors:
Laura Chiticariu, Yoav Goldberg, Gus Hahn-Powell, Clayton T. Morrison, Aakanksha Naik, Rebecca Sharp, Mihai Surdeanu, Marco Valenzuela-Escárcega, Enrique Noriega-Atala
Venue:
PANDL
SIG:
Publisher:
International Conference on Computational Linguistics
Note:
Pages:
21–28
Language:
URL:
https://aclanthology.org/2022.pandl-1.3
DOI:
Bibkey:
Cite (ACL):
Indrajit Bhattacharya, Subhasish Ghosh, Arpita Kundu, Pratik Saini, and Tapas Nayak. 2022. Unsupervised Generation of Long-form Technical Questions from Textbook Metadata using Structured Templates. In Proceedings of the First Workshop on Pattern-based Approaches to NLP in the Age of Deep Learning, pages 21–28, Gyeongju, Republic of Korea. International Conference on Computational Linguistics.
Cite (Informal):
Unsupervised Generation of Long-form Technical Questions from Textbook Metadata using Structured Templates (Bhattacharya et al., PANDL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.pandl-1.3.pdf