JusticeLeague at FIGNEWS 2024 Shared Task: Innovations in Bias Annotation

Amr Saleh, Huda Mohamed, Hager Sayed


Abstract
In response to the evolving media representation of the Gaza-Israel conflict, this study aims to categorize news articles based on their bias towards specific entities. Our primary objective is to annotate news articles with labels that indicate their bias: “Unbiased”, “Biased against Palestine”, “Biased against Israel”, “Biased against both Palestine and Israel”, “Biased against others”, “Unclear”, or “Not Applicable”.The methodology involves a detailed annotation process where each article is carefully reviewed and labeled according to predefined guidelines. For instance, an article reporting factual events without derogatory language is labeled as “Unbiased”, while one using inflammatory language against Palestinians is marked as “Biased against Palestine”.Key findings include the identification of various degrees of bias in news articles, highlighting the importance of critical analysis in media consumption. This research contributes to the broader effort of understanding media bias and promoting unbiased journalism. Tools such as Google Drive and Google Sheets facilitated the annotation process, enabling efficient collaboration and data management among the annotators.Our work also includes comprehensive guidelines and examples to ensure consistent annotation, enhancing the reliability of the data.
Anthology ID:
2024.arabicnlp-1.71
Volume:
Proceedings of The Second Arabic Natural Language Processing Conference
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Nizar Habash, Houda Bouamor, Ramy Eskander, Nadi Tomeh, Ibrahim Abu Farha, Ahmed Abdelali, Samia Touileb, Injy Hamed, Yaser Onaizan, Bashar Alhafni, Wissam Antoun, Salam Khalifa, Hatem Haddad, Imed Zitouni, Badr AlKhamissi, Rawan Almatham, Khalil Mrini
Venues:
ArabicNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
651–655
Language:
URL:
https://aclanthology.org/2024.arabicnlp-1.71
DOI:
10.18653/v1/2024.arabicnlp-1.71
Bibkey:
Cite (ACL):
Amr Saleh, Huda Mohamed, and Hager Sayed. 2024. JusticeLeague at FIGNEWS 2024 Shared Task: Innovations in Bias Annotation. In Proceedings of The Second Arabic Natural Language Processing Conference, pages 651–655, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
JusticeLeague at FIGNEWS 2024 Shared Task: Innovations in Bias Annotation (Saleh et al., ArabicNLP-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.arabicnlp-1.71.pdf