User Impressions of Questions to Acquire Lexical Knowledge

Kazunori Komatani, Mikio Nakano


Abstract
For the acquisition of knowledge through dialogues, it is crucial for systems to ask questions that do not diminish the user’s willingness to talk, i.e., that do not degrade the user’s impression. This paper reports the results of our analysis on how user impression changes depending on the types of questions to acquire lexical knowledge, that is, explicit and implicit questions, and the correctness of the content of the questions. We also analyzed how sequences of the same type of questions affect user impression. User impression scores were collected from 104 participants recruited via crowdsourcing and then regression analysis was conducted. The results demonstrate that implicit questions give a good impression when their content is correct, but a bad impression otherwise. We also found that consecutive explicit questions are more annoying than implicit ones when the content of the questions is correct. Our findings reveal helpful insights for creating a strategy to avoid user impression deterioration during knowledge acquisition.
Anthology ID:
2020.sigdial-1.19
Volume:
Proceedings of the 21th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Month:
July
Year:
2020
Address:
1st virtual meeting
Editors:
Olivier Pietquin, Smaranda Muresan, Vivian Chen, Casey Kennington, David Vandyke, Nina Dethlefs, Koji Inoue, Erik Ekstedt, Stefan Ultes
Venue:
SIGDIAL
SIG:
SIGDIAL
Publisher:
Association for Computational Linguistics
Note:
Pages:
147–156
Language:
URL:
https://aclanthology.org/2020.sigdial-1.19
DOI:
10.18653/v1/2020.sigdial-1.19
Bibkey:
Cite (ACL):
Kazunori Komatani and Mikio Nakano. 2020. User Impressions of Questions to Acquire Lexical Knowledge. In Proceedings of the 21th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 147–156, 1st virtual meeting. Association for Computational Linguistics.
Cite (Informal):
User Impressions of Questions to Acquire Lexical Knowledge (Komatani & Nakano, SIGDIAL 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.sigdial-1.19.pdf
Video:
 https://youtube.com/watch?v=-i9XnHcoIRc