BanMANI: A Dataset to Identify Manipulated Social Media News in Bangla

Mahammed Kamruzzaman, Md. Minul Islam Shovon, Gene Kim


Abstract
Initial work has been done to address fake news detection and misrepresentation of news in the Bengali language. However, no work in Bengali yet addresses the identification of specific claims in social media news that falsely manipulate a related news article. At this point, this problem has been tackled in English and a few other languages, but not in the Bengali language. In this paper, we curate a dataset of social media content labeled with information manipulation relative to reference articles, called BanMANI. The dataset collection method we describe works around the limitations of the available NLP tools in Bangla. We expect these techniques will carry over to building similar datasets in other low-resource languages. BanMANI forms the basis both for evaluating the capabilities of existing NLP systems and for training or fine-tuning new models specifically on this task. In our analysis, we find that this task challenges current LLMs both under zero-shot and fine-tuned set- things
Anthology ID:
2023.contents-1.7
Volume:
Proceedings of the Workshop on Computational Terminology in NLP and Translation Studies (ConTeNTS) Incorporating the 16th Workshop on Building and Using Comparable Corpora (BUCC)
Month:
September
Year:
2023
Address:
Varna, Bulgaria
Editors:
Amal Haddad Haddad, Ayla Rigouts Terryn, Ruslan Mitkov, Reinhard Rapp, Pierre Zweigenbaum, Serge Sharoff
Venues:
ConTeNTS | WS
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
51–58
Language:
URL:
https://aclanthology.org/2023.contents-1.7
DOI:
Bibkey:
Cite (ACL):
Mahammed Kamruzzaman, Md. Minul Islam Shovon, and Gene Kim. 2023. BanMANI: A Dataset to Identify Manipulated Social Media News in Bangla. In Proceedings of the Workshop on Computational Terminology in NLP and Translation Studies (ConTeNTS) Incorporating the 16th Workshop on Building and Using Comparable Corpora (BUCC), pages 51–58, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
BanMANI: A Dataset to Identify Manipulated Social Media News in Bangla (Kamruzzaman et al., ConTeNTS-WS 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.contents-1.7.pdf