Grounded Complex Task Segmentation for Conversational Assistants

Rafael Ferreira, David Semedo, Joao Magalhaes


Abstract
Following complex instructions in conversational assistants can be quite daunting due to the shorter attention and memory spans when compared to reading the same instructions. Hence, when conversational assistants walk users through the steps of complex tasks, there is a need to structure the task into manageable pieces of information of the right length and complexity. In this paper, we tackle the recipes domain and convert reading structured instructions into conversational structured ones. We annotated the structure of instructions according to a conversational scenario, which provided insights into what is expected in this setting. To computationally model the conversational step’s characteristics, we tested various Transformer-based architectures, showing that a token-based approach delivers the best results. A further user study showed that users tend to favor steps of manageable complexity and length, and that the proposed methodology can improve the original web-based instructional text. Specifically, 86% of the evaluated tasks were improved from a conversational suitability point of view.
Anthology ID:
2023.sigdial-1.4
Volume:
Proceedings of the 24th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Month:
September
Year:
2023
Address:
Prague, Czechia
Editors:
Svetlana Stoyanchev, Shafiq Joty, David Schlangen, Ondrej Dusek, Casey Kennington, Malihe Alikhani
Venue:
SIGDIAL
SIG:
SIGDIAL
Publisher:
Association for Computational Linguistics
Note:
Pages:
43–54
Language:
URL:
https://aclanthology.org/2023.sigdial-1.4
DOI:
10.18653/v1/2023.sigdial-1.4
Bibkey:
Cite (ACL):
Rafael Ferreira, David Semedo, and Joao Magalhaes. 2023. Grounded Complex Task Segmentation for Conversational Assistants. In Proceedings of the 24th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 43–54, Prague, Czechia. Association for Computational Linguistics.
Cite (Informal):
Grounded Complex Task Segmentation for Conversational Assistants (Ferreira et al., SIGDIAL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.sigdial-1.4.pdf