Evaluation Strategies for Computational Construction Grammars

Tânia Marques, Katrien Beuls


Abstract
Despite the growing number of Computational Construction Grammar implementations, the field is still lacking evaluation methods to compare grammar fragments across different platforms. Moreover, the hand-crafted nature of most grammars requires profiling tools to understand the complex interactions between constructions of different types. This paper presents a number of evaluation measures, partially based on existing measures in the field of semantic parsing, that are especially relevant for reversible grammar formalisms. The measures are tested on a grammar fragment for European Portuguese clitic placement that is currently under development.
Anthology ID:
C16-1108
Volume:
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers
Month:
December
Year:
2016
Address:
Osaka, Japan
Editors:
Yuji Matsumoto, Rashmi Prasad
Venue:
COLING
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
1137–1146
Language:
URL:
https://aclanthology.org/C16-1108
DOI:
Bibkey:
Cite (ACL):
Tânia Marques and Katrien Beuls. 2016. Evaluation Strategies for Computational Construction Grammars. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 1137–1146, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Evaluation Strategies for Computational Construction Grammars (Marques & Beuls, COLING 2016)
Copy Citation:
PDF:
https://aclanthology.org/C16-1108.pdf