Requesting clarifications with speech and gestures

Jonathan Ginzburg, Andy Luecking


Abstract
In multimodal natural language interaction both speech and non-speech gestures are involved in the basic mechanism of grounding and repair. We discuss a couple of multimodal clarifica- tion requests and argue that gestures, as well as speech expressions, underlie comparable paral- lelism constraints. In order to make this precise, we slightly extend the formal dialogue frame- work KoS to cover also gestural counterparts of verbal locutionary propositions.
Anthology ID:
2021.mmsr-1.3
Volume:
Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR)
Month:
June
Year:
2021
Address:
Groningen, Netherlands (Online)
Editors:
Lucia Donatelli, Nikhil Krishnaswamy, Kenneth Lai, James Pustejovsky
Venue:
MMSR
SIG:
SIGSEM
Publisher:
Association for Computational Linguistics
Note:
Pages:
21–31
Language:
URL:
https://aclanthology.org/2021.mmsr-1.3
DOI:
Bibkey:
Cite (ACL):
Jonathan Ginzburg and Andy Luecking. 2021. Requesting clarifications with speech and gestures. In Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR), pages 21–31, Groningen, Netherlands (Online). Association for Computational Linguistics.
Cite (Informal):
Requesting clarifications with speech and gestures (Ginzburg & Luecking, MMSR 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.mmsr-1.3.pdf