Ellogon Casual Annotation Infrastructure

Georgios Petasis, Leonidas Tsekouras


Abstract
This paper presents a new annotation paradigm, casual annotation, along with a proposed architecture and a reference implementation, the Ellogon Casual Annotation Tool, which implements this paradigm and architecture. The novel aspects of the proposed paradigm originate from the vision to tightly integrate annotation with the casual, everyday activities of users. Annotating in a less “controlled” environment, and removing the bottleneck of selecting content and importing it to annotation infrastructures, casual annotation provides the ability to vastly increase the content that can be annotated and ease the annotation process through automatic pre-training. The proposed paradigm, architecture and reference implementation has been evaluated for more than two years on an annotation task related to sentiment analysis. Evaluation results suggest that, at least for this annotation task, there is a huge improvement in productivity after casual annotation adoption, in comparison to the more traditional annotation paradigms followed in the early stages of the annotation task.
Anthology ID:
2020.lrec-1.412
Volume:
Proceedings of the Twelfth Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
3360–3365
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.412
DOI:
Bibkey:
Cite (ACL):
Georgios Petasis and Leonidas Tsekouras. 2020. Ellogon Casual Annotation Infrastructure. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 3360–3365, Marseille, France. European Language Resources Association.
Cite (Informal):
Ellogon Casual Annotation Infrastructure (Petasis & Tsekouras, LREC 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.lrec-1.412.pdf