Multimodal Behaviour and Feedback in Different Types of Interaction

Costanza Navarretta, Patrizia Paggio


Abstract
In this article, we compare feedback-related multimodal behaviours in two different types of interactions: first encounters between two participants who do not know each other in advance, and naturally-occurring conversations between two and three participants recorded at their homes. All participants are Danish native speakers. The interactions are transcribed using the same methodology, and the multimodal behaviours are annotated according to the same annotation scheme. In the study we focus on the most frequently occurring feedback expressions in the interactions and on feedback-related head movements and facial expressions. The analysis of the corpora, while confirming general facts about feedback-related head movements and facial expressions previously reported in the literature, also shows that the physical setting, the number of participants, the topics discussed, and the degree of familiarity influence the use of gesture types and the frequency of feedback-related expressions and gestures.
Anthology ID:
L12-1365
Volume:
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
Month:
May
Year:
2012
Address:
Istanbul, Turkey
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
2338–2342
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/635_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Costanza Navarretta and Patrizia Paggio. 2012. Multimodal Behaviour and Feedback in Different Types of Interaction. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 2338–2342, Istanbul, Turkey. European Language Resources Association (ELRA).
Cite (Informal):
Multimodal Behaviour and Feedback in Different Types of Interaction (Navarretta & Paggio, LREC 2012)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/635_Paper.pdf