On the Interpretability of Deep Learning Models for Collaborative Argumentation Analysis in Classrooms

Deliang Wang, Gaowei Chen


Abstract
Collaborative argumentation holds significant potential for enhancing students’ learning outcomes within classroom settings. Consequently, researchers have explored the application of artificial intelligence (AI) to automatically analyze argumentation in these contexts. Despite the remarkable performance of deep learning models in this task, their lack of interpretability poses a critical challenge, leading to teachers’ skepticism and limited utilization. To cultivate trust among teachers, this PhD thesis proposal aims to leverage explainable AI techniques to provide explanations for these deep learning models. Specifically, the study develops two deep learning models for automated analysis of argument moves (claim, evidence, and warrant) and specificity levels (low, medium, and high) within collaborative argumentation. To address the interpretability issue, four explainable AI methods are proposed: gradient sensitivity, gradient input, integrated gradient, and LIME. Computational experiments demonstrate the efficacy of these methods in elucidating model predictions by computing word contributions, with LIME delivering exceptional performance. Moreover, a quasi-experiment is designed to evaluate the impact of model explanations on user trust and knowledge, serving as a future study of this PhD proposal. By tackling the challenges of interpretability and trust, this PhD thesis proposal aims to contribute to fostering user trust in AI and facilitating the practical implementation of AI in educational contexts.
Anthology ID:
2024.acl-srw.9
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Xiyan Fu, Eve Fleisig
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
92–102
Language:
URL:
https://aclanthology.org/2024.acl-srw.9
DOI:
Bibkey:
Cite (ACL):
Deliang Wang and Gaowei Chen. 2024. On the Interpretability of Deep Learning Models for Collaborative Argumentation Analysis in Classrooms. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop), pages 92–102, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
On the Interpretability of Deep Learning Models for Collaborative Argumentation Analysis in Classrooms (Wang & Chen, ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-srw.9.pdf