SimXAI: A Simple Drop-in Layer Increases Interaction Quality and Understanding in Conversational XAI

Van Bach Nguyen, Qianli Wang, Nils Feldhus, Jörg Schlötterer, Christin Seifert


Abstract
Conversational explainable AI (ConvXAI) agents often use GUS-style architectures with separate modules for intent recognition, dialogue management, and template-based response generation. While faithful to the underlying XAI methods, these pipelines are hard to adapt and often struggle with context-dependent follow-up questions. We present SimXAI, a lightweight LLM-centric conversational layer that replaces these modules with a single tool-calling LLM that bridges access to existing XAI resources. Rather than a standalone agent, SimXAI serves as a modular interface that enables conversational access to external XAI resources. We further introduce an evaluation suite for single- and multi-turn parsing, faithfulness, and contextualization. Across existing and new datasets, SimXAI achieves strong function-selection accuracy and high faithfulness while better handling context-dependent requests. In a user study replacing only the conversational layer of TalkToModel, a representative GUS-based agent, users completed tasks more accurately and in fewer turn. Overall, SimXAI improves GUS-based design while preserving faithfulness and improving conversational quality.
Anthology ID:
2026.findings-emnlp.20
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
391–408
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.20/
DOI:
Bibkey:
Cite (ACL):
Van Bach Nguyen, Qianli Wang, Nils Feldhus, Jörg Schlötterer, and Christin Seifert. 2026. SimXAI: A Simple Drop-in Layer Increases Interaction Quality and Understanding in Conversational XAI. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 391–408, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SimXAI: A Simple Drop-in Layer Increases Interaction Quality and Understanding in Conversational XAI (Nguyen et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.20.pdf