Generating Simple, Conservative and Unifying Explanations for Logistic Regression Models

Sameen Maruf, Ingrid Zukerman, Xuelin Situ, Cecile Paris, Gholamreza Haffari


Abstract
In this paper, we generate and compare three types of explanations of Machine Learning (ML) predictions: simple, conservative and unifying. Simple explanations are concise, conservative explanations address the surprisingness of a prediction, and unifying explanations convey the extent to which an ML model’s predictions are applicable. The results of our user study show that (1) conservative and unifying explanations are liked equally and considered largely equivalent in terms of completeness, helpfulness for understanding the AI, and enticement to act, and both are deemed better than simple explanations; and (2)users’ views about explanations are influenced by the (dis)agreement between the ML model’s predictions and users’ estimations of these predictions, and by the inclusion/omission of features users expect to see in explanations.
Anthology ID:
2024.inlg-main.9
Volume:
Proceedings of the 17th International Natural Language Generation Conference
Month:
September
Year:
2024
Address:
Tokyo, Japan
Editors:
Saad Mahamood, Nguyen Le Minh, Daphne Ippolito
Venue:
INLG
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
103–120
Language:
URL:
https://aclanthology.org/2024.inlg-main.9
DOI:
Bibkey:
Cite (ACL):
Sameen Maruf, Ingrid Zukerman, Xuelin Situ, Cecile Paris, and Gholamreza Haffari. 2024. Generating Simple, Conservative and Unifying Explanations for Logistic Regression Models. In Proceedings of the 17th International Natural Language Generation Conference, pages 103–120, Tokyo, Japan. Association for Computational Linguistics.
Cite (Informal):
Generating Simple, Conservative and Unifying Explanations for Logistic Regression Models (Maruf et al., INLG 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.inlg-main.9.pdf