Clustering-Based Article Identification in Historical Newspapers

Martin Riedl, Daniela Betz, Sebastian Padó


Abstract
This article focuses on the problem of identifying articles and recovering their text from within and across newspaper pages when OCR just delivers one text file per page. We frame the task as a segmentation plus clustering step. Our results on a sample of 1912 New York Tribune magazine shows that performing the clustering based on similarities computed with word embeddings outperforms a similarity measure based on character n-grams and words. Furthermore, the automatic segmentation based on the text results in low scores, due to the low quality of some OCRed documents.
Anthology ID:
W19-2502
Volume:
Proceedings of the 3rd Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature
Month:
June
Year:
2019
Address:
Minneapolis, USA
Editors:
Beatrice Alex, Stefania Degaetano-Ortlieb, Anna Kazantseva, Nils Reiter, Stan Szpakowicz
Venue:
LaTeCH
SIG:
SIGHUM
Publisher:
Association for Computational Linguistics
Note:
Pages:
12–17
Language:
URL:
https://aclanthology.org/W19-2502
DOI:
10.18653/v1/W19-2502
Bibkey:
Cite (ACL):
Martin Riedl, Daniela Betz, and Sebastian Padó. 2019. Clustering-Based Article Identification in Historical Newspapers. In Proceedings of the 3rd Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature, pages 12–17, Minneapolis, USA. Association for Computational Linguistics.
Cite (Informal):
Clustering-Based Article Identification in Historical Newspapers (Riedl et al., LaTeCH 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-2502.pdf
Code
 riedlma/cluster_identification