Cultural Topic Modelling over Novel Wikipedia Corpora for South-Slavic Languages

Filip Markoski, Elena Markoska, Nikola Ljubešić, Eftim Zdravevski, Ljupco Kocarev


Abstract
There is a shortage of high-quality corpora for South-Slavic languages. Such corpora are useful to computer scientists and researchers in social sciences and humanities alike, focusing on numerous linguistic, content analysis, and natural language processing applications. This paper presents a workflow for mining Wikipedia content and processing it into linguistically-processed corpora, applied on the Bosnian, Bulgarian, Croatian, Macedonian, Serbian, Serbo-Croatian and Slovenian Wikipedia. We make the resulting seven corpora publicly available. We showcase these corpora by comparing the content of the underlying Wikipedias, our assumption being that the content of the Wikipedias reflects broadly the interests in various topics in these Balkan nations. We perform the content comparison by using topic modelling algorithms and various distribution comparisons. The results show that all Wikipedias are topically rather similar, with all of them covering art, culture, and literature, whereas they contain differences in geography, politics, history and science.
Anthology ID:
2021.ranlp-1.104
Volume:
Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021)
Month:
September
Year:
2021
Address:
Held Online
Editors:
Ruslan Mitkov, Galia Angelova
Venue:
RANLP
SIG:
Publisher:
INCOMA Ltd.
Note:
Pages:
910–917
Language:
URL:
https://aclanthology.org/2021.ranlp-1.104
DOI:
Bibkey:
Cite (ACL):
Filip Markoski, Elena Markoska, Nikola Ljubešić, Eftim Zdravevski, and Ljupco Kocarev. 2021. Cultural Topic Modelling over Novel Wikipedia Corpora for South-Slavic Languages. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021), pages 910–917, Held Online. INCOMA Ltd..
Cite (Informal):
Cultural Topic Modelling over Novel Wikipedia Corpora for South-Slavic Languages (Markoski et al., RANLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.ranlp-1.104.pdf