Learning on Structured Documents for Conditional Question Answering

Wang Zihan, Qian Hongjin, Dou Zhicheng


Abstract
“Conditional question answering (CQA) is an important task in natural language processing thatinvolves answering questions that depend on specific conditions. CQA is crucial for domainsthat require the provision of personalized advice or making context-dependent analyses, such aslegal consulting and medical diagnosis. However, existing CQA models struggle with generatingmultiple conditional answers due to two main challenges: (1) the lack of supervised training datawith diverse conditions and corresponding answers, and (2) the difficulty to output in a complexformat that involves multiple conditions and answers. To address the challenge of limited super-vision, we propose LSD (Learning on Structured Documents), a self-supervised learning methodon structured documents for CQA. LSD involves a conditional problem generation method anda contrastive learning objective. The model is trained with LSD on massive unlabeled structureddocuments and is fine-tuned on labeled CQA dataset afterwards. To overcome the limitation ofoutputting answers with complex formats in CQA, we propose a pipeline that enables the gen-eration of multiple answers and conditions. Experimental results on the ConditionalQA datasetdemonstrate that LSD outperforms previous CQA models in terms of accuracy both in providinganswers and conditions.”
Anthology ID:
2023.ccl-1.51
Volume:
Proceedings of the 22nd Chinese National Conference on Computational Linguistics
Month:
August
Year:
2023
Address:
Harbin, China
Editors:
Maosong Sun, Bing Qin, Xipeng Qiu, Jing Jiang, Xianpei Han
Venue:
CCL
SIG:
Publisher:
Chinese Information Processing Society of China
Note:
Pages:
583–599
Language:
English
URL:
https://aclanthology.org/2023.ccl-1.51
DOI:
Bibkey:
Cite (ACL):
Wang Zihan, Qian Hongjin, and Dou Zhicheng. 2023. Learning on Structured Documents for Conditional Question Answering. In Proceedings of the 22nd Chinese National Conference on Computational Linguistics, pages 583–599, Harbin, China. Chinese Information Processing Society of China.
Cite (Informal):
Learning on Structured Documents for Conditional Question Answering (Zihan et al., CCL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.ccl-1.51.pdf