An Open Corpus for Named Entity Recognition in Historic Newspapers

Clemens Neudecker


Abstract
The availability of openly available textual datasets (“corpora”) with highly accurate manual annotations (“gold standard”) of named entities (e.g. persons, locations, organizations, etc.) is crucial in the training and evaluation of named entity recognition systems. Currently there are only few such datasets available on the web, and even less for texts containing historical spelling variation. The production and subsequent release into the public domain of four such datasets with 100 pages each for the languages Dutch, French, German (including Austrian) as part of the Europeana Newspapers project is expected to contribute to the further development and improvement of named entity recognition systems with a focus on historical content. This paper describes how these datasets were produced, what challenges were encountered in their creation and informs about their final quality and availability.
Anthology ID:
L16-1689
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
4348–4352
Language:
URL:
https://aclanthology.org/L16-1689
DOI:
Bibkey:
Cite (ACL):
Clemens Neudecker. 2016. An Open Corpus for Named Entity Recognition in Historic Newspapers. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 4348–4352, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
An Open Corpus for Named Entity Recognition in Historic Newspapers (Neudecker, LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1689.pdf
Code
 EuropeanaNewspapers/ner-corpora
Data
Europeana Newspapers