An Event-based Abductive Learning for Hard Time-sensitive Question Answering

Shaojuan Wu, Jitong Li, Xiaowang Zhang, Zhiyong Feng


Abstract
Time-Sensitive Question Answering (TSQA) is to answer questions qualified for a certain timestamp based on the given document. It is split into easy and hard modes depending on whether the document contain time qualifiers mentioned in the question. While existing models have performed well on easy mode, their performance is significant reduced for answering hard time-sensitive questions, whose time qualifiers are implicit in the document. An intuitive idea is to match temporal events in the given document by treating time-sensitive question as a temporal event of missing objects. However, not all temporal events extracted from the document have explicit time qualifiers. In this paper, we propose an Event-AL framework, in which a graph pruning model is designed to locate the timespan of implicit temporal events by capturing temporal relation between events. Moreover, we present an abductive reasoning module to determine proper objects while providing explanations. Besides, as the same relation may be scattered throughout the document in diverse expressions, a relation-based prompt is introduced to instructs LLMs in extracting candidate temporal events. We conduct extensive experiment and results show that Event-AL outperforms strong baselines for hard time-sensitive questions, with a 12.7% improvement in EM scores. In addition, it also exhibits great superiority for multi-answer and beyond hard time-sensitive questions.
Anthology ID:
2024.lrec-main.99
Volume:
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
Venues:
LREC | COLING
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
1105–1115
Language:
URL:
https://aclanthology.org/2024.lrec-main.99
DOI:
Bibkey:
Cite (ACL):
Shaojuan Wu, Jitong Li, Xiaowang Zhang, and Zhiyong Feng. 2024. An Event-based Abductive Learning for Hard Time-sensitive Question Answering. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 1105–1115, Torino, Italia. ELRA and ICCL.
Cite (Informal):
An Event-based Abductive Learning for Hard Time-sensitive Question Answering (Wu et al., LREC-COLING 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.lrec-main.99.pdf
Optional supplementary material:
 2024.lrec-main.99.OptionalSupplementaryMaterial.zip