Continuous Quality Control and Advanced Text Segment Annotation with WAT-SL 2.0

Christina Lohr, Johannes Kiesel, Stephanie Luther, Johannes Hellrich, Tobias Kolditz, Benno Stein, Udo Hahn


Abstract
Today’s widely used annotation tools were designed for annotating typically short textual mentions of entities or relations, making their interface cumbersome to use for long(er) stretches of text, e.g, sentences running over several lines in a document. They also lack systematic support for hierarchically structured labels, i.e., one label being conceptually more general than another (e.g., anamnesis in relation to family anamnesis). Moreover, as a more fundamental shortcoming of today’s tools, they provide no continuous quality con trol mechanisms for the annotation process, an essential feature to intrinsically support iterative cycles in the development of annotation guidelines. We alleviated these problems by developing WAT-SL 2.0, an open-source web-based annotation tool for long-segment labeling, hierarchically structured label sets and built-ins for quality control.
Anthology ID:
W19-4025
Volume:
Proceedings of the 13th Linguistic Annotation Workshop
Month:
August
Year:
2019
Address:
Florence, Italy
Venue:
LAW
SIG:
SIGANN
Publisher:
Association for Computational Linguistics
Note:
Pages:
215–219
Language:
URL:
https://aclanthology.org/W19-4025
DOI:
10.18653/v1/W19-4025
Bibkey:
Cite (ACL):
Christina Lohr, Johannes Kiesel, Stephanie Luther, Johannes Hellrich, Tobias Kolditz, Benno Stein, and Udo Hahn. 2019. Continuous Quality Control and Advanced Text Segment Annotation with WAT-SL 2.0. In Proceedings of the 13th Linguistic Annotation Workshop, pages 215–219, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
Continuous Quality Control and Advanced Text Segment Annotation with WAT-SL 2.0 (Lohr et al., LAW 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-4025.pdf
Code
 webis-de/wat