Conversational Grounding in Multimodal Dialog Systems

Biswesh Mohapatra


Abstract
The process of “conversational grounding” is an interactive process that has been studied extensively in cognitive science, whereby participants in a conversation check to make sure their interlocutors understand what is being referred to. This interactive process uses multiple modes of communication to establish the information between the participants. This could include information provided through eye-gaze, head movements, intonation in speech, along with the content of the speech. While the process is essential to successful communication between humans and between humans and machines, work needs to be done on testing and building the capabilities of the current dialogue system in managing conversational grounding, especially in multimodal medium of communication. Recent work such as Benotti and Blackburn have shown the importance of conversational grounding in dialog systems and how current systems fail in them. This is essential for the advancement of Embodied Conversational Agents and Social Robots. Thus my PhD project aims to test, understand and improve the functioning of current dialog models with respect to Conversational Grounding.
Anthology ID:
2023.yrrsds-1.5
Volume:
Proceedings of the 19th Annual Meeting of the Young Reseachers' Roundtable on Spoken Dialogue Systems
Month:
September
Year:
2023
Address:
Prague, Czechia
Editors:
Vojtech Hudecek, Patricia Schmidtova, Tanvi Dinkar, Javier Chiyah-Garcia, Weronika Sieinska
Venues:
YRRSDS | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
15–17
Language:
URL:
https://aclanthology.org/2023.yrrsds-1.5
DOI:
Bibkey:
Cite (ACL):
Biswesh Mohapatra. 2023. Conversational Grounding in Multimodal Dialog Systems. In Proceedings of the 19th Annual Meeting of the Young Reseachers' Roundtable on Spoken Dialogue Systems, pages 15–17, Prague, Czechia. Association for Computational Linguistics.
Cite (Informal):
Conversational Grounding in Multimodal Dialog Systems (Mohapatra, YRRSDS-WS 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.yrrsds-1.5.pdf