Prompting Few-shot Multi-hop Question Generation via Comprehending Type-aware Semantics

Zefeng Lin, Weidong Chen, Yan Song, Yongdong Zhang


Abstract
Given several documents, multi-hop question generation (MQG) is a task aims to generate complicated questions that require reasoning over multiple pieces of these documents to find the answer. To perform this task, existing studies focus on designing advanced architectures to locate essential keywords or sentences in multiple documents and then generate questions accordingly, where they normally do not note that question types could provide crucial hints for extracting key information from the documents for MQG. In general, supervised approaches are used that rely on large annotated data, which is not available in many low-resource scenarios and thus makes MQG hard in these domains. Consider the recent success of large language models (LLMs) on natural language processing tasks using limited labeled data under few-shot settings, in this paper, we propose an approach named type-aware semantics extraction-based chain-of-thought method (TASE-CoT) for few-shot MQG. Specifically, our approach firstly extracts question types and essential semantic phrases from the given documents and the answer. Then, we design a three-step CoT template to leverage the extracted question type and semantic phrases to predict multi-hop questions. Extensive experiments and the results demonstrate the effectiveness of our approach and the proposed modules.
Anthology ID:
2024.findings-naacl.236
Volume:
Findings of the Association for Computational Linguistics: NAACL 2024
Month:
June
Year:
2024
Address:
Mexico City, Mexico
Editors:
Kevin Duh, Helena Gomez, Steven Bethard
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3730–3740
Language:
URL:
https://aclanthology.org/2024.findings-naacl.236
DOI:
10.18653/v1/2024.findings-naacl.236
Bibkey:
Cite (ACL):
Zefeng Lin, Weidong Chen, Yan Song, and Yongdong Zhang. 2024. Prompting Few-shot Multi-hop Question Generation via Comprehending Type-aware Semantics. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 3730–3740, Mexico City, Mexico. Association for Computational Linguistics.
Cite (Informal):
Prompting Few-shot Multi-hop Question Generation via Comprehending Type-aware Semantics (Lin et al., Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-naacl.236.pdf