Are UD Treebanks Getting More Consistent? A Report Card for English UD

Amir Zeldes, Nathan Schneider


Abstract
Recent efforts to consolidate guidelines and treebanks in the Universal Dependencies project raise the expectation that joint training and dataset comparison is increasingly possible for high-resource languages such as English, which have multiple corpora. Focusing on the two largest UD English treebanks, we examine progress in data consolidation and answer several questions: Are UD English treebanks becoming more internally consistent? Are they becoming more like each other and to what extent? Is joint training a good idea, and if so, since which UD version? Our results indicate that while consolidation has made progress, joint models may still suffer from inconsistencies, which hamper their ability to leverage a larger pool of training data.
Anthology ID:
2023.udw-1.7
Volume:
Proceedings of the Sixth Workshop on Universal Dependencies (UDW, GURT/SyntaxFest 2023)
Month:
March
Year:
2023
Address:
Washington, D.C.
Editors:
Loïc Grobol, Francis Tyers
Venues:
UDW | SyntaxFest
SIG:
SIGPARSE
Publisher:
Association for Computational Linguistics
Note:
Pages:
58–64
Language:
URL:
https://aclanthology.org/2023.udw-1.7
DOI:
Bibkey:
Cite (ACL):
Amir Zeldes and Nathan Schneider. 2023. Are UD Treebanks Getting More Consistent? A Report Card for English UD. In Proceedings of the Sixth Workshop on Universal Dependencies (UDW, GURT/SyntaxFest 2023), pages 58–64, Washington, D.C.. Association for Computational Linguistics.
Cite (Informal):
Are UD Treebanks Getting More Consistent? A Report Card for English UD (Zeldes & Schneider, UDW-SyntaxFest 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.udw-1.7.pdf