Balancing Transparency and Accuracy: A Comparative Analysis of Rule-Based and Deep Learning Models in Political Bias Classification

Manuel Nunez Martinez, Sonja Schmer-Galunder, Zoey Liu, Sangpil Youm, Chathuri Jayaweera, Bonnie J. Dorr


Abstract
The unchecked spread of digital information, combined with increasing political polarization and the tendency of individuals to isolate themselves from opposing political viewpoints opposing views, has driven researchers to develop systems for automatically detecting political bias in media. This trend has been further fueled by discussions on social media. We explore methods for categorizing bias in US news articles, comparing rule-based and deep learning approaches. The study highlights the sensitivity of modern self-learning systems to unconstrained data ingestion, while reconsidering the strengths of traditional rule-based systems. Applying both models to left-leaning (CNN) and right-leaning (FOX) News articles, we assess their effectiveness on data beyond the original training and test sets. This analysis highlights each model’s accuracy, offers a framework for exploring deep-learning explainability, and sheds light on political bias in US news media. We contrast the opaque architecture of a deep learning model with the transparency of a linguistically informed rule-based model, showing that the rule-based model performs consistently across different data conditions and offers greater transparency, whereas the deep learning model is dependent on the training set and struggles with unseen data.
Anthology ID:
2024.sicon-1.7
Volume:
Proceedings of the Second Workshop on Social Influence in Conversations (SICon 2024)
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
James Hale, Kushal Chawla, Muskan Garg
Venue:
SICon
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
102–115
Language:
URL:
https://aclanthology.org/2024.sicon-1.7
DOI:
Bibkey:
Cite (ACL):
Manuel Nunez Martinez, Sonja Schmer-Galunder, Zoey Liu, Sangpil Youm, Chathuri Jayaweera, and Bonnie J. Dorr. 2024. Balancing Transparency and Accuracy: A Comparative Analysis of Rule-Based and Deep Learning Models in Political Bias Classification. In Proceedings of the Second Workshop on Social Influence in Conversations (SICon 2024), pages 102–115, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
Balancing Transparency and Accuracy: A Comparative Analysis of Rule-Based and Deep Learning Models in Political Bias Classification (Martinez et al., SICon 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.sicon-1.7.pdf