Topic-Aware Causal Intervention for Counterfactual Detection

Thong Thanh Nguyen, Truc-My Nguyen


Abstract
Counterfactual statements, which describe events that did not or cannot take place, are beneficial to numerous NLP applications. Hence, we consider the problem of counterfactual detection (CFD) and seek to enhance the CFD models. Previous models are reliant on clue phrases to predict counterfactuality, so they suffer from significant performance drop when clue phrase hints do not exist during testing. Moreover, these models tend to predict non-counterfactuals over counterfactuals. To address these issues, we propose to integrate neural topic model into the CFD model to capture the global semantics of the input statement. We continue to causally intervene the hidden representations of the CFD model to balance the effect of the class labels. Extensive experiments show that our approach outperforms previous state-of-the-art CFD and bias-resolving methods in both the CFD and other bias-sensitive tasks.
Anthology ID:
2024.nlp4dh-1.16
Volume:
Proceedings of the 4th International Conference on Natural Language Processing for Digital Humanities
Month:
November
Year:
2024
Address:
Miami, USA
Editors:
Mika Hämäläinen, Emily Öhman, So Miyagawa, Khalid Alnajjar, Yuri Bizzoni
Venue:
NLP4DH
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
165–176
Language:
URL:
https://aclanthology.org/2024.nlp4dh-1.16
DOI:
Bibkey:
Cite (ACL):
Thong Thanh Nguyen and Truc-My Nguyen. 2024. Topic-Aware Causal Intervention for Counterfactual Detection. In Proceedings of the 4th International Conference on Natural Language Processing for Digital Humanities, pages 165–176, Miami, USA. Association for Computational Linguistics.
Cite (Informal):
Topic-Aware Causal Intervention for Counterfactual Detection (Nguyen & Nguyen, NLP4DH 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.nlp4dh-1.16.pdf