Twente Debate Corpus — A Multimodal Corpus for Head Movement Analysis

Bayu Rahayudi, Ronald Poppe, Dirk Heylen


Abstract
This paper introduces a multimodal discussion corpus for the study into head movement and turn-taking patterns in debates. Given that participants either acted alone or in a pair, cooperation and competition and their nonverbal correlates can be analyzed. In addition to the video and audio of the recordings, the corpus contains automatically estimated head movements, and manual annotations of who is speaking and who is looking where. The corpus consists of over 2 hours of debates, in 6 groups with 18 participants in total. We describe the recording setup and present initial analyses of the recorded data. We found that the person who acted as single debater speaks more and also receives more attention compared to the other debaters, also when corrected for the time speaking. We also found that a single debater was more likely to speak after a team debater. Future work will be aimed at further analysis of the relation between speaking and looking patterns, the outcome of the debate and perceived dominance of the debaters.
Anthology ID:
L14-1315
Volume:
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
Month:
May
Year:
2014
Address:
Reykjavik, Iceland
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
4184–4188
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/364_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Bayu Rahayudi, Ronald Poppe, and Dirk Heylen. 2014. Twente Debate Corpus — A Multimodal Corpus for Head Movement Analysis. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 4184–4188, Reykjavik, Iceland. European Language Resources Association (ELRA).
Cite (Informal):
Twente Debate Corpus — A Multimodal Corpus for Head Movement Analysis (Rahayudi et al., LREC 2014)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/364_Paper.pdf