A mixed word / morphological approach for extending CELEX for high coverage on contemporary large corpora

Joris Vaneyghen, Guy De Pauw, Dirk Van Compernolle, Walter Daelemans


Abstract
This paper describes an alternative approach to morphological language modeling, which incorporates constraints on the morphological production of new words. This is done by applying the constraints as a preprocessing step in which only one morphological production rule can be applied to an extended lexicon of knownmorphemes, lemmas and word forms. This approach is used to extend the CELEX Dutch morphological database, so that a higher coverage can be reached on a largecorpus of Dutch newspaper articles. We present experimental results on the coverage of this extended database and use the extension to further evaluate our morphologicalsystem, as well as the impact of the constraints on the coverage of out-of-vocabulary words.
Anthology ID:
L06-1353
Volume:
Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06)
Month:
May
Year:
2006
Address:
Genoa, Italy
Editors:
Nicoletta Calzolari, Khalid Choukri, Aldo Gangemi, Bente Maegaard, Joseph Mariani, Jan Odijk, Daniel Tapias
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2006/pdf/583_pdf.pdf
DOI:
Bibkey:
Cite (ACL):
Joris Vaneyghen, Guy De Pauw, Dirk Van Compernolle, and Walter Daelemans. 2006. A mixed word / morphological approach for extending CELEX for high coverage on contemporary large corpora. In Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06), Genoa, Italy. European Language Resources Association (ELRA).
Cite (Informal):
A mixed word / morphological approach for extending CELEX for high coverage on contemporary large corpora (Vaneyghen et al., LREC 2006)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2006/pdf/583_pdf.pdf