A Multimodal Motion-Captured Corpus of Matched and Mismatched Extravert-Introvert Conversational Pairs

Jackson Tolins, Kris Liu, Yingying Wang, Jean E. Fox Tree, Marilyn Walker, Michael Neff


Abstract
This paper presents a new corpus, the Personality Dyads Corpus, consisting of multimodal data for three conversations between three personality-matched, two-person dyads (a total of 9 separate dialogues). Participants were selected from a larger sample to be 0.8 of a standard deviation above or below the mean on the Big-Five Personality extraversion scale, to produce an Extravert-Extravert dyad, an Introvert-Introvert dyad, and an Extravert-Introvert dyad. Each pair carried out conversations for three different tasks. The conversations were recorded using optical motion capture for the body and data gloves for the hands. Dyads’ speech was transcribed and the gestural and postural behavior was annotated with ANVIL. The released corpus includes personality profiles, ANVIL files containing speech transcriptions and the gestural annotations, and BVH files containing body and hand motion in 3D.
Anthology ID:
L16-1553
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
3469–3476
Language:
URL:
https://aclanthology.org/L16-1553
DOI:
Bibkey:
Cite (ACL):
Jackson Tolins, Kris Liu, Yingying Wang, Jean E. Fox Tree, Marilyn Walker, and Michael Neff. 2016. A Multimodal Motion-Captured Corpus of Matched and Mismatched Extravert-Introvert Conversational Pairs. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 3469–3476, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
A Multimodal Motion-Captured Corpus of Matched and Mismatched Extravert-Introvert Conversational Pairs (Tolins et al., LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1553.pdf