A CUP of CoFee: A large Collection of feedback Utterances Provided with communicative function annotations

Laurent Prévot, Jan Gorisch, Roxane Bertrand


Abstract
There have been several attempts to annotate communicative functions to utterances of verbal feedback in English previously. Here, we suggest an annotation scheme for verbal and non-verbal feedback utterances in French including the categories base, attitude, previous and visual. The data comprises conversations, maptasks and negotiations from which we extracted ca. 13,000 candidate feedback utterances and gestures. 12 students were recruited for the annotation campaign of ca. 9,500 instances. Each instance was annotated by between 2 and 7 raters. The evaluation of the annotation agreement resulted in an average best-pair kappa of 0.6. While the base category with the values acknowledgement, evaluation, answer, elicit achieve good agreement, this is not the case for the other main categories. The data sets, which also include automatic extractions of lexical, positional and acoustic features, are freely available and will further be used for machine learning classification experiments to analyse the form-function relationship of feedback.
Anthology ID:
L16-1507
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
3180–3185
Language:
URL:
https://aclanthology.org/L16-1507
DOI:
Bibkey:
Cite (ACL):
Laurent Prévot, Jan Gorisch, and Roxane Bertrand. 2016. A CUP of CoFee: A large Collection of feedback Utterances Provided with communicative function annotations. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 3180–3185, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
A CUP of CoFee: A large Collection of feedback Utterances Provided with communicative function annotations (Prévot et al., LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1507.pdf