How Users React to Proactive Voice Assistant Behavior While Driving

Maria Schmidt, Wolfgang Minker, Steffen Werner


Abstract
Nowadays Personal Assistants (PAs) are available in multiple environments and become increasingly popular to use via voice. Therefore, we aim to provide proactive PA suggestions to car drivers via speech. These suggestions should be neither obtrusive nor increase the drivers’ cognitive load, while enhancing user experience. To assess these factors, we conducted a usability study in which 42 participants perceive proactive voice output in a Wizard-of-Oz study in a driving simulator. Traffic density was varied during a highway drive and it included six in-car-specific use cases. The latter were presented by a proactive voice assistant and in a non-proactive control condition. We assessed the users’ subjective cognitive load and their satisfaction in different questionnaires during the interaction with both PA variants. Furthermore, we analyze the user reactions: both regarding their content and the elapsed response times to PA actions. The results show that proactive assistant behavior is rated similarly positive as non-proactive behavior. Furthermore, the participants agreed to 73.8% of proactive suggestions. In line with previous research, driving-relevant use cases receive the best ratings, here we reach 82.5% acceptance. Finally, the users reacted significantly faster to proactive PA actions, which we interpret as less cognitive load compared to non-proactive behavior.
Anthology ID:
2020.lrec-1.61
Volume:
Proceedings of the Twelfth Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
485–490
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.61
DOI:
Bibkey:
Cite (ACL):
Maria Schmidt, Wolfgang Minker, and Steffen Werner. 2020. How Users React to Proactive Voice Assistant Behavior While Driving. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 485–490, Marseille, France. European Language Resources Association.
Cite (Informal):
How Users React to Proactive Voice Assistant Behavior While Driving (Schmidt et al., LREC 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.lrec-1.61.pdf