Redcoat: A Collaborative Annotation Tool for Hierarchical Entity Typing

Michael Stewart, Wei Liu, Rachel Cardell-Oliver


Abstract
We introduce Redcoat, a web-based annotation tool that supports collaborative hierarchical entity typing. As an annotation tool, Redcoat also facilitates knowledge elicitation by allowing the creation and continuous refinement of concept hierarchies during annotation. It aims to minimise not only annotation time but the time it takes for project creators to set up and distribute projects to annotators. Projects created using the web-based interface can be rapidly distributed to a list of email addresses. Redcoat handles the propagation of documents amongst annotators and automatically scales the annotation workload depending on the number of active annotators. In this paper we discuss these key features and outline Redcoat’s system architecture. We also highlight Redcoat’s unique benefits over existing annotation tools via a qualitative comparison.
Anthology ID:
D19-3033
Volume:
Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP): System Demonstrations
Month:
November
Year:
2019
Address:
Hong Kong, China
Editors:
Sebastian Padó, Ruihong Huang
Venues:
EMNLP | IJCNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
193–198
Language:
URL:
https://aclanthology.org/D19-3033
DOI:
10.18653/v1/D19-3033
Bibkey:
Cite (ACL):
Michael Stewart, Wei Liu, and Rachel Cardell-Oliver. 2019. Redcoat: A Collaborative Annotation Tool for Hierarchical Entity Typing. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP): System Demonstrations, pages 193–198, Hong Kong, China. Association for Computational Linguistics.
Cite (Informal):
Redcoat: A Collaborative Annotation Tool for Hierarchical Entity Typing (Stewart et al., EMNLP-IJCNLP 2019)
Copy Citation:
PDF:
https://aclanthology.org/D19-3033.pdf