2014
pdf
bib
abs
Modeling and evaluating dialog success in the LAST MINUTE corpus
Dietmar Rösner
|
Rafael Friesen
|
Stephan Günther
|
Rico Andrich
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
The LAST MINUTE corpus comprises records and transcripts of naturalistic problem solving dialogs between N = 130 subjects and a companion system simulated in a Wizard of Oz experiment. Our goal is to detect dialog situations where subjects might break up the dialog with the system which might happen when the subject is unsuccessful. We present a dialog act based representation of the dialog courses in the problem solving phase of the experiment and propose and evaluate measures for dialog success or failure derived from this representation. This dialog act representation refines our previous coarse measure as it enables the correct classification of many dialog sequences that were ambiguous before. The dialog act representation is useful for the identification of different subject groups and the exploration of interesting dialog courses in the corpus. We find young females to be most successful in the challenging last part of the problem solving phase and young subjects to have the initiative in the dialog more often than the elderly.
2012
pdf
bib
abs
LAST MINUTE: a Multimodal Corpus of Speech-based User-Companion Interactions
Dietmar Rösner
|
Jörg Frommer
|
Rafael Friesen
|
Matthias Haase
|
Julia Lange
|
Mirko Otto
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
We report about design and characteristics of the LAST MINUTE corpus. The recordings in this data collection are taken from a WOZ experiment that allows to investigate how users interact with a companion system in a mundane situation with the need for planning, re-planning and strategy change. The resulting corpus is distinguished with respect to aspects of size (e.g. number of subjects, length of sessions, number of channels, total length of records) as well as quality (e.g. balancedness of cohort, well designed scenario, standard based transcripts, psychological questionnaires, accompanying in-depth interviews).
pdf
bib
abs
Towards Emotion and Affect Detection in the Multimodal LAST MINUTE Corpus
Jörg Frommer
|
Bernd Michaelis
|
Dietmar Rösner
|
Andreas Wendemuth
|
Rafael Friesen
|
Matthias Haase
|
Manuela Kunze
|
Rico Andrich
|
Julia Lange
|
Axel Panning
|
Ingo Siegert
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
The LAST MINUTE corpus comprises multimodal recordings (e.g. video, audio, transcripts) from WOZ interactions in a mundane planning task (Rösner et al., 2011). It is one of the largest corpora with naturalistic data currently available. In this paper we report about first results from attempts to automatically and manually analyze the different modes with respect to emotions and affects exhibited by the subjects. We describe and discuss difficulties encountered due to the strong contrast between the naturalistic recordings and traditional databases with acted emotions.