DARE: Towards Robust Text Explanations in Biomedical and Healthcare Applications

Adam Ivankay, Mattia Rigotti, Pascal Frossard


Abstract
Along with the successful deployment of deep neural networks in several application domains, the need to unravel the black-box nature of these networks has seen a significant increase recently. Several methods have been introduced to provide insight into the inference process of deep neural networks. However, most of these explainability methods have been shown to be brittle in the face of adversarial perturbations of their inputs in the image and generic textual domain. In this work we show that this phenomenon extends to specific and important high stakes domains like biomedical datasets. In particular, we observe that the robustness of explanations should be characterized in terms of the accuracy of the explanation in linking a model’s inputs and its decisions - faithfulness - and its relevance from the perspective of domain experts - plausibility. This is crucial to prevent explanations that are inaccurate but still look convincing in the context of the domain at hand. To this end, we show how to adapt current attribution robustness estimation methods to a given domain, so as to take into account domain-specific plausibility. This results in our DomainAdaptiveAREstimator (DARE) attribution robustness estimator, allowing us to properly characterize the domain-specific robustness of faithful explanations. Next, we provide two methods, adversarial training and FAR training, to mitigate the brittleness characterized by DARE, allowing us to train networks that display robust attributions. Finally, we empirically validate our methods with extensive experiments on three established biomedical benchmarks.
Anthology ID:
2023.acl-long.644
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
11499–11533
Language:
URL:
https://aclanthology.org/2023.acl-long.644
DOI:
10.18653/v1/2023.acl-long.644
Bibkey:
Cite (ACL):
Adam Ivankay, Mattia Rigotti, and Pascal Frossard. 2023. DARE: Towards Robust Text Explanations in Biomedical and Healthcare Applications. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 11499–11533, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
DARE: Towards Robust Text Explanations in Biomedical and Healthcare Applications (Ivankay et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.644.pdf
Video:
 https://aclanthology.org/2023.acl-long.644.mp4