Wikipedia Titles As Noun Tag Predictors

Armin Hoenen


Abstract
In this paper, we investigate a covert labeling cue, namely the probability that a title (by example of the Wikipedia titles) is a noun. If this probability is very large, any list such as or comparable to the Wikipedia titles can be used as a reliable word-class (or part-of-speech tag) predictor or noun lexicon. This may be especially useful in the case of Low Resource Languages (LRL) where labeled data is lacking and putatively for Natural Language Processing (NLP) tasks such as Word Sense Disambiguation, Sentiment Analysis and Machine Translation. Profitting from the ease of digital publication on the web as opposed to print, LRL speaker communities produce resources such as Wikipedia and Wiktionary, which can be used for an assessment. We provide statistical evidence for a strong noun bias for the Wikipedia titles from 2 corpora (English, Persian) and a dictionary (Japanese) and for a typologically balanced set of 17 languages including LRLs. Additionally, we conduct a small experiment on predicting noun tags for out-of-vocabulary items in part-of-speech tagging for English.
Anthology ID:
L16-1335
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
2114–2118
Language:
URL:
https://aclanthology.org/L16-1335
DOI:
Bibkey:
Cite (ACL):
Armin Hoenen. 2016. Wikipedia Titles As Noun Tag Predictors. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 2114–2118, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Wikipedia Titles As Noun Tag Predictors (Hoenen, LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1335.pdf