Asymmetric feature interaction for interpreting model predictions

Xiaolei Lu, Jianghong Ma, Haode Zhang


Abstract
In natural language processing (NLP), deep neural networks (DNNs) could model complex interactions between context and have achieved impressive results on a range of NLP tasks. Prior works on feature interaction attribution mainly focus on studying symmetric interaction that only explains the additional influence of a set of words in combination, which fails to capture asymmetric influence that contributes to model prediction. In this work, we propose an asymmetric feature interaction attribution explanation model that aims to explore asymmetric higher-order feature interactions in the inference of deep neural NLP models. By representing our explanation with an directed interaction graph, we experimentally demonstrate interpretability of the graph to discover asymmetric feature interactions. Experimental results on two sentiment classification datasets show the superiority of our model against the state-of-the-art feature interaction attribution methods in identifying influential features for model predictions.
Anthology ID:
2023.findings-acl.286
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4666–4678
Language:
URL:
https://aclanthology.org/2023.findings-acl.286
DOI:
10.18653/v1/2023.findings-acl.286
Bibkey:
Cite (ACL):
Xiaolei Lu, Jianghong Ma, and Haode Zhang. 2023. Asymmetric feature interaction for interpreting model predictions. In Findings of the Association for Computational Linguistics: ACL 2023, pages 4666–4678, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Asymmetric feature interaction for interpreting model predictions (Lu et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.286.pdf
Video:
 https://aclanthology.org/2023.findings-acl.286.mp4