Using Transition Duration to Improve Turn-taking in Conversational Agents

Charles Threlkeld, Muhammad Umair, Jp de Ruiter


Abstract
Smooth turn-taking is an important aspect of natural conversation that allows interlocutors to maintain adequate mutual comprehensibility. In human communication, the timing between utterances is normatively constrained, and deviations convey socially relevant paralinguistic information. However, for spoken dialogue systems, smooth turn-taking continues to be a challenge. This motivates the need for spoken dialogue systems to employ a robust model of turn-taking to ensure that messages are exchanged smoothly and without transmitting unintended paralinguistic information. In this paper, we examine dialogue data from natural human interaction to develop an evidence-based model for turn-timing in spoken dialogue systems. First, we use timing between turns to develop two models of turn-taking: a speaker-agnostic model and a speaker-sensitive model. From the latter model, we derive the propensity of listeners to take the next turn given TRP duration. Finally, we outline how this measure may be incorporated into a spoken dialogue system to improve the naturalness of conversation.
Anthology ID:
2022.sigdial-1.20
Volume:
Proceedings of the 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue
Month:
September
Year:
2022
Address:
Edinburgh, UK
Editors:
Oliver Lemon, Dilek Hakkani-Tur, Junyi Jessy Li, Arash Ashrafzadeh, Daniel Hernández Garcia, Malihe Alikhani, David Vandyke, Ondřej Dušek
Venue:
SIGDIAL
SIG:
SIGDIAL
Publisher:
Association for Computational Linguistics
Note:
Pages:
193–203
Language:
URL:
https://aclanthology.org/2022.sigdial-1.20
DOI:
10.18653/v1/2022.sigdial-1.20
Bibkey:
Cite (ACL):
Charles Threlkeld, Muhammad Umair, and Jp de Ruiter. 2022. Using Transition Duration to Improve Turn-taking in Conversational Agents. In Proceedings of the 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 193–203, Edinburgh, UK. Association for Computational Linguistics.
Cite (Informal):
Using Transition Duration to Improve Turn-taking in Conversational Agents (Threlkeld et al., SIGDIAL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.sigdial-1.20.pdf
Video:
 https://youtu.be/KDjyyabmzWU