Corpus vs. Lexicon Supervision in Morphosyntactic Tagging: the Case of Slovene

Nikola Ljubešić, Tomaž Erjavec


Abstract
In this paper we present a tagger developed for inflectionally rich languages for which both a training corpus and a lexicon are available. We do not constrain the tagger by the lexicon entries, allowing both for lexicon incompleteness and noisiness. By using the lexicon indirectly through features we allow for known and unknown words to be tagged in the same manner. We test our tagger on Slovene data, obtaining a 25% error reduction of the best previous results both on known and unknown words. Given that Slovene is, in comparison to some other Slavic languages, a well-resourced language, we perform experiments on the impact of token (corpus) vs. type (lexicon) supervision, obtaining useful insights in how to balance the effort of extending resources to yield better tagging results.
Anthology ID:
L16-1242
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1527–1531
Language:
URL:
https://aclanthology.org/L16-1242
DOI:
Bibkey:
Cite (ACL):
Nikola Ljubešić and Tomaž Erjavec. 2016. Corpus vs. Lexicon Supervision in Morphosyntactic Tagging: the Case of Slovene. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 1527–1531, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Corpus vs. Lexicon Supervision in Morphosyntactic Tagging: the Case of Slovene (Ljubešić & Erjavec, LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1242.pdf
Code
 clarinsi/reldi-tagger