What Persists across Web Crawls? Genre and News Topic Variation in South Slavic Web Corpora

Nikola Ljubešić, Vuk Dinić, Peter Rupnik


Abstract
This work investigates content persistence across two independently constructed versions of the CLASSLA-web corpora for seven South Slavic languages, crawled approximately two years apart, with available document-level genre and topic metadata. Persistence is defined as the presence of a near-duplicate document in both versions of the corpora, which occurs on average in 19% of cases. Genre and news-topic persistence rankings are moderately consistent across languages. Web domain availability after two years is moderately associated with genre persistence (r=.49, R2=.24), but not with topic persistence within news (r=-.04). Topic-level differences therefore appear to arise mainly within surviving news websites, where reference-oriented content tends to persist more than event-bound content.
Anthology ID:
2026.wac-1.5
Volume:
Proceedings of the 13th Web-as-Corpus Workshop
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pedro Ortiz Suarez, Laurie Burchell, Nikola Ljubešić, Yves Scherrer, Veronika Laippala, Vuk Dinić, Thom Vaughan
Venues:
WAC | WS
SIG:
SIGWAC
Publisher:
Association for Computational Linguistics
Note:
Pages:
53–59
Language:
URL:
https://aclanthology.org/2026.wac-1.5/
DOI:
Bibkey:
Cite (ACL):
Nikola Ljubešić, Vuk Dinić, and Peter Rupnik. 2026. What Persists across Web Crawls? Genre and News Topic Variation in South Slavic Web Corpora. In Proceedings of the 13th Web-as-Corpus Workshop, pages 53–59, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
What Persists across Web Crawls? Genre and News Topic Variation in South Slavic Web Corpora (Ljubešić et al., WAC 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wac-1.5.pdf