CHAMP: Efficient Annotation and Consolidation of Cluster Hierarchies

Arie Cattan, Tom Hope, Doug Downey, Roy Bar-Haim, Lilach Eden, Yoav Kantor, Ido Dagan


Abstract
Various NLP tasks require a complex hierarchical structure over nodes, where each node is a cluster of items. Examples include generating entailment graphs, hierarchical cross-document coreference resolution, annotating event and subevent relations, etc. To enable efficient annotation of such hierarchical structures, we release CHAMP, an open source tool allowing to incrementally construct both clusters and hierarchy simultaneously over any type of texts. This incremental approach significantly reduces annotation time compared to the common pairwise annotation approach and also guarantees maintaining transitivity at the cluster and hierarchy levels. Furthermore, CHAMP includes a consolidation mode, where an adjudicator can easily compare multiple cluster hierarchy annotations and resolve disagreements.
Anthology ID:
2023.emnlp-demo.37
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Month:
December
Year:
2023
Address:
Singapore
Editors:
Yansong Feng, Els Lefever
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
403–412
Language:
URL:
https://aclanthology.org/2023.emnlp-demo.37
DOI:
10.18653/v1/2023.emnlp-demo.37
Bibkey:
Cite (ACL):
Arie Cattan, Tom Hope, Doug Downey, Roy Bar-Haim, Lilach Eden, Yoav Kantor, and Ido Dagan. 2023. CHAMP: Efficient Annotation and Consolidation of Cluster Hierarchies. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 403–412, Singapore. Association for Computational Linguistics.
Cite (Informal):
CHAMP: Efficient Annotation and Consolidation of Cluster Hierarchies (Cattan et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-demo.37.pdf
Video:
 https://aclanthology.org/2023.emnlp-demo.37.mp4