Temporal Validity Change Prediction

Georg Wenzel, Adam Jatowt


Abstract
Temporal validity is an important property of text that has many downstream applications, such as recommender systems, conversational AI, and user status tracking. Existing benchmarking tasks often require models to identify the temporal validity duration of a single statement. However, many data sources contain additional context, such as successive sentences in a story or posts on a social media profile. This context may alter the duration for which the originally collected statement is expected to be valid. We propose Temporal Validity Change Prediction, a natural language processing task benchmarking the capability of machine learning models to detect context statements that induce such change. We create a dataset consisting of temporal target statements sourced from Twitter and crowdsource corresponding context statements. We then benchmark a set of transformer-based language models on our dataset. Finally, we experiment with a multitasking approach to improve the state-of-the-art performance.
Anthology ID:
2024.findings-acl.84
Volume:
Findings of the Association for Computational Linguistics: ACL 2024
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1424–1446
Language:
URL:
https://aclanthology.org/2024.findings-acl.84
DOI:
10.18653/v1/2024.findings-acl.84
Bibkey:
Cite (ACL):
Georg Wenzel and Adam Jatowt. 2024. Temporal Validity Change Prediction. In Findings of the Association for Computational Linguistics: ACL 2024, pages 1424–1446, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Temporal Validity Change Prediction (Wenzel & Jatowt, Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-acl.84.pdf