Structure-Discourse Hierarchical Graph for Conditional Question Answering on Long Documents

Haowei Du, Yansong Feng, Chen Li, Yang Li, Yunshi Lan, Dongyan Zhao


Abstract
Conditional question answering on long documents aims to find probable answers and identify conditions that need to be satisfied to make the answers correct over long documents. Existing approaches solve this task by segmenting long documents into multiple sections, and attending information at global and local tokens to predict the answers and corresponding conditions. However, the natural structure of the document and discourse relations between sentences in each document section are ignored, which are crucial for condition retrieving across sections, as well as logical interaction over the question and conditions. To address this issue, this paper constructs a Structure-Discourse Hierarchical Graph (SDHG) and conducts bottom-up information propagation. Firstly we build the sentence-level discourse graphs for each section and encode the discourse relations by graph attention. Secondly, we construct a section-level structure graph based on natural structures, and conduct interactions over the question and contexts. Finally different levels of representations are integrated into jointly answer and condition decoding. The experiments on the benchmark ConditionalQA shows our approach gains over the prior state-of-the-art, by 3.0 EM score and 2.4 F1 score on answer measuring, as well as 2.2 EM score and 1.9 F1 score on jointly answer and condition measuring.
Anthology ID:
2023.findings-acl.391
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6282–6293
Language:
URL:
https://aclanthology.org/2023.findings-acl.391
DOI:
10.18653/v1/2023.findings-acl.391
Bibkey:
Cite (ACL):
Haowei Du, Yansong Feng, Chen Li, Yang Li, Yunshi Lan, and Dongyan Zhao. 2023. Structure-Discourse Hierarchical Graph for Conditional Question Answering on Long Documents. In Findings of the Association for Computational Linguistics: ACL 2023, pages 6282–6293, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Structure-Discourse Hierarchical Graph for Conditional Question Answering on Long Documents (Du et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.391.pdf