The OFAI Multi-Modal Task Description Corpus

Stephanie Schreitter, Brigitte Krenn


Abstract
The OFAI Multimodal Task Description Corpus (OFAI-MMTD Corpus) is a collection of dyadic teacher-learner (human-human and human-robot) interactions. The corpus is multimodal and tracks the communication signals exchanged between interlocutors in task-oriented scenarios including speech, gaze and gestures. The focus of interest lies on the communicative signals conveyed by the teacher and which objects are salient at which time. Data are collected from four different task description setups which involve spatial utterances, navigation instructions and more complex descriptions of joint tasks.
Anthology ID:
L16-1224
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1408–1414
Language:
URL:
https://aclanthology.org/L16-1224
DOI:
Bibkey:
Cite (ACL):
Stephanie Schreitter and Brigitte Krenn. 2016. The OFAI Multi-Modal Task Description Corpus. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 1408–1414, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
The OFAI Multi-Modal Task Description Corpus (Schreitter & Krenn, LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1224.pdf