An Annotation Approach for Social and Referential Gaze in Dialogue

Vidya Somashekarappa, Christine Howes, Asad Sayeed


Abstract
This paper introduces an approach for annotating eye gaze considering both its social and the referential functions in multi-modal human-human dialogue. Detecting and interpreting the temporal patterns of gaze behavior cues is natural for humans and also mostly an unconscious process. However, these cues are difficult for conversational agents such as robots or avatars to process or generate. The key factor is to recognize these variants and carry out a successful conversation, as misinterpretation can lead to total failure of the given interaction. This paper introduces an annotation scheme for eye-gaze in human-human dyadic interactions that is intended to facilitate the learning of eye-gaze patterns in multi-modal natural dialogue.
Anthology ID:
2020.lrec-1.95
Volume:
Proceedings of the Twelfth Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
759–765
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.95
DOI:
Bibkey:
Cite (ACL):
Vidya Somashekarappa, Christine Howes, and Asad Sayeed. 2020. An Annotation Approach for Social and Referential Gaze in Dialogue. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 759–765, Marseille, France. European Language Resources Association.
Cite (Informal):
An Annotation Approach for Social and Referential Gaze in Dialogue (Somashekarappa et al., LREC 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.lrec-1.95.pdf