Evolving Large Text Corpora: Four Versions of the Icelandic Gigaword Corpus

Starkaður Barkarson, Steinþór Steingrímsson, Hildur Hafsteinsdóttir


Abstract
The Icelandic Gigaword Corpus was first published in 2018. Since then new versions have been published annually, containing new texts from additional sources as well as from previous sources. This paper describes the evolution of the corpus in its first four years. All versions are made available under permissive licenses and with each new version the texts are annotated with the latest and most accurate tools. We show how the corpus has grown almost 50% in size from the first version to the fourth and how it was restructured in order to better accommodate different meta-data for different subcorpora. Furthermore, other services have been set up to facilitate usage of the corpus for different use cases. These include a keyword-in-context concordance tool, an n-gram viewer, a word frequency database and pre-trained word embeddings.
Anthology ID:
2022.lrec-1.254
Volume:
Proceedings of the Thirteenth Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
2371–2381
Language:
URL:
https://aclanthology.org/2022.lrec-1.254
DOI:
Bibkey:
Cite (ACL):
Starkaður Barkarson, Steinþór Steingrímsson, and Hildur Hafsteinsdóttir. 2022. Evolving Large Text Corpora: Four Versions of the Icelandic Gigaword Corpus. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 2371–2381, Marseille, France. European Language Resources Association.
Cite (Informal):
Evolving Large Text Corpora: Four Versions of the Icelandic Gigaword Corpus (Barkarson et al., LREC 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.lrec-1.254.pdf