“You move THIS!”: Annotation of Pointing Gestures on Tabletop Interfaces in Low Awareness Situations

Dimitra Anastasiou, Hoorieh Afkari, Valérie Maquil


Abstract
This paper analyses pointing gestures during low awareness situations occurring in a collaborative problem-solving activity implemented on an interactive tabletop interface. Awareness is considered as crucial requirement to support fluid and natural collaboration. We focus on pointing gestures as strategy to maintain awareness. We describe the results from a user study with five groups, each group consisting of three participants, who were asked to solve a task collaboratively on a tabletop interface. The ideal problem-solving solution would have been, if the three participants had been fully aware of what their personal area is depicting and had communicated this properly to the peers. However, often some participants are hesitant due to lack of awareness, some other want to take the lead work or expedite the process, and therefore pointing gestures to others’ personal areas arise. Our results from analyzing a multimodal corpus of 168.68 minutes showed that in 95% of the cases, one user pointed to the personal area of the other, while in a few cases (3%) a user not only pointed, but also performed a touch gesture on the personal area of another user. In our study, the mean for such pointing gestures in low awareness situations per minute and for all groups was M=1.96, SD=0.58.
Anthology ID:
2020.onion-1.4
Volume:
Proceedings of LREC2020 Workshop "People in language, vision and the mind" (ONION2020)
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Patrizia Paggio, Albert Gatt, Roman Klinger
Venue:
ONION
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
22–27
Language:
English
URL:
https://aclanthology.org/2020.onion-1.4
DOI:
Bibkey:
Cite (ACL):
Dimitra Anastasiou, Hoorieh Afkari, and Valérie Maquil. 2020. “You move THIS!”: Annotation of Pointing Gestures on Tabletop Interfaces in Low Awareness Situations. In Proceedings of LREC2020 Workshop "People in language, vision and the mind" (ONION2020), pages 22–27, Marseille, France. European Language Resources Association (ELRA).
Cite (Informal):
“You move THIS!”: Annotation of Pointing Gestures on Tabletop Interfaces in Low Awareness Situations (Anastasiou et al., ONION 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.onion-1.4.pdf