GATE Teamware 2: An open-source tool for collaborative document classification annotation

David Wilby, Twin Karmakharm, Ian Roberts, Xingyi Song, Kalina Bontcheva


Abstract
We present GATE Teamware 2: an open-source web-based platform for managing teams of annotators working on document classification tasks. GATE Teamware 2 is an entirely re-engineered successor to GATE Teamware, using contemporary web frameworks. The software allows the management of teams of multiple annotators, project managers and administrators - including the management of annotators - across multiple projects. Projects can be configured to control and monitor the annotation statistics and have a highly flexible JSON-configurable annotation display which can include arbitrary HTML. Optionally, documents can be uploaded with pre-existing annotations and documents are served to annotators in a random order by default to reduce bias. Crucially, annotators can be trained on applying the annotation guidelines correctly and then screened for quality assurance purposes, prior to being cleared for independent annotation. GATE Teamware 2 can be self-deployed, including in container orchestration environments, or provided as private, hosted cloud instances.GATE Teamware 2 is an open-source software and can be downloaded from https://github.com/GATENLP/gate-teamware.A demonstration video of the system has also been made available at https://youtu.be/KoXkuhc4fmM.
Anthology ID:
2023.eacl-demo.17
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Danilo Croce, Luca Soldaini
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
145–151
Language:
URL:
https://aclanthology.org/2023.eacl-demo.17
DOI:
10.18653/v1/2023.eacl-demo.17
Bibkey:
Cite (ACL):
David Wilby, Twin Karmakharm, Ian Roberts, Xingyi Song, and Kalina Bontcheva. 2023. GATE Teamware 2: An open-source tool for collaborative document classification annotation. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations, pages 145–151, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
GATE Teamware 2: An open-source tool for collaborative document classification annotation (Wilby et al., EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-demo.17.pdf
Video:
 https://aclanthology.org/2023.eacl-demo.17.mp4