Bias Detection Using Textual Representation of Multimedia Contents

Karthik L. Nagar, Aditya Mohan Singh, Sowmya Rasipuram, Roshni Ramnani, Milind Savagaonkar, Anutosh Maitra


Abstract
The presence of biased and prejudicial content in social media has become a pressing concern, given its potential to inflict severe societal damage. Detecting and addressing such bias is imperative, as the rapid dissemination of skewed content has the capacity to disrupt social harmony. Advanced deep learning models are now paving the way for the automatic detection of bias in multimedia content with human-like accuracy. This paper focuses on identifying social bias in social media images. Toward this, we curated a Social Bias Image Dataset (SBID), consisting of 300 bias/no-bias images. The images contain both textual and visual information. We scientifically annotated the dataset for four different categories of bias. Our methodology involves generating a textual representation of the image content leveraging state-of-the-art models of optical character recognition (OCR), image captioning, and character attribute extraction. Initially, we performed fine-tuning on a Bidirectional Encoder Representations from Transformers (BERT) network to classify bias and no-bias, as well as on a Bidirectional AutoRegressive Transformer (BART) network for bias categorization, utilizing an extensive textual corpus. Further, these networks were finetuned on the image dataset built by us SBID. The experimental findings presented herein underscore the effectiveness of these models in identifying various forms of bias in social media images. We will also demonstrate their capacity to discern both explicit and implicit bias.
Anthology ID:
2023.icon-1.33
Volume:
Proceedings of the 20th International Conference on Natural Language Processing (ICON)
Month:
December
Year:
2023
Address:
Goa University, Goa, India
Editors:
Jyoti D. Pawar, Sobha Lalitha Devi
Venue:
ICON
SIG:
SIGLEX
Publisher:
NLP Association of India (NLPAI)
Note:
Pages:
408–416
Language:
URL:
https://aclanthology.org/2023.icon-1.33
DOI:
Bibkey:
Cite (ACL):
Karthik L. Nagar, Aditya Mohan Singh, Sowmya Rasipuram, Roshni Ramnani, Milind Savagaonkar, and Anutosh Maitra. 2023. Bias Detection Using Textual Representation of Multimedia Contents. In Proceedings of the 20th International Conference on Natural Language Processing (ICON), pages 408–416, Goa University, Goa, India. NLP Association of India (NLPAI).
Cite (Informal):
Bias Detection Using Textual Representation of Multimedia Contents (L. Nagar et al., ICON 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.icon-1.33.pdf