Chain-of-Exemplar: Enhancing Distractor Generation for Multimodal Educational Question Generation

Haohao Luo, Yang Deng, Ying Shen, See-Kiong Ng, Tat-Seng Chua


Abstract
Multiple-choice questions (MCQs) are important in enhancing concept learning and student engagement for educational purposes. Despite the multimodal nature of educational content, current methods focus mainly on text-based inputs and often neglect the integration of visual information. In this work, we study the problem of multimodal educational question generation, which aims at generating subject-specific educational questions with plausible yet incorrect distractors based on multimodal educational content. To tackle this problem, we introduce a novel framework, named Chain-of-Exemplar (CoE), which utilizes multimodal large language models (MLLMs) with Chain-of-Thought reasoning to improve the generation of challenging distractors. Furthermore, CoE leverages three-stage contextualized exemplar retrieval to retrieve exemplary questions as guides for generating more subject-specific educational questions. Experimental results on the ScienceQA benchmark demonstrate the superiority of CoE in both question generation and distractor generation over existing methods across various subjects and educational levels.
Anthology ID:
2024.acl-long.432
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7978–7993
Language:
URL:
https://aclanthology.org/2024.acl-long.432
DOI:
Bibkey:
Cite (ACL):
Haohao Luo, Yang Deng, Ying Shen, See-Kiong Ng, and Tat-Seng Chua. 2024. Chain-of-Exemplar: Enhancing Distractor Generation for Multimodal Educational Question Generation. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7978–7993, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Chain-of-Exemplar: Enhancing Distractor Generation for Multimodal Educational Question Generation (Luo et al., ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-long.432.pdf