RST-Tace A tool for automatic comparison and evaluation of RST trees

Shujun Wan, Tino Kutschbach, Anke Lüdeling, Manfred Stede


Abstract
This paper presents RST-Tace, a tool for automatic comparison and evaluation of RST trees. RST-Tace serves as an implementation of Iruskieta’s comparison method, which allows trees to be compared and evaluated without the influence of decisions at lower levels in a tree in terms of four factors: constituent, attachment point, nuclearity as well as relation. RST-Tace can be used regardless of the language or the size of rhetorical trees. This tool aims to measure the agreement between two annotators. The result is reflected by F-measure and inter-annotator agreement. Both the comparison table and the result of the evaluation can be obtained automatically.
Anthology ID:
W19-2712
Volume:
Proceedings of the Workshop on Discourse Relation Parsing and Treebanking 2019
Month:
June
Year:
2019
Address:
Minneapolis, MN
Editors:
Amir Zeldes, Debopam Das, Erick Maziero Galani, Juliano Desiderato Antonio, Mikel Iruskieta
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
88–96
Language:
URL:
https://aclanthology.org/W19-2712
DOI:
10.18653/v1/W19-2712
Bibkey:
Cite (ACL):
Shujun Wan, Tino Kutschbach, Anke Lüdeling, and Manfred Stede. 2019. RST-Tace A tool for automatic comparison and evaluation of RST trees. In Proceedings of the Workshop on Discourse Relation Parsing and Treebanking 2019, pages 88–96, Minneapolis, MN. Association for Computational Linguistics.
Cite (Informal):
RST-Tace A tool for automatic comparison and evaluation of RST trees (Wan et al., NAACL 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-2712.pdf
Code
 tkutschbach/RST-Tace