ToxVidLM: A Multimodal Framework for Toxicity Detection in Code-Mixed Videos

Krishanu Maity, A.s. Poornash, Sriparna Saha, Pushpak Bhattacharyya


Abstract
In an era of rapidly evolving internet technology, the surge in multimodal content, including videos, has expanded the horizons of online communication. However, the detection of toxic content in this diverse landscape, particularly in low-resource code-mixed languages, remains a critical challenge. While substantial research has addressed toxic content detection in textual data, the realm of video content, especially in non-English languages, has been relatively underexplored. This paper addresses this research gap by introducing a benchmark dataset, the first of its kind, consisting of 931 videos with 4021 code-mixed Hindi-English utterances collected from YouTube. Each utterance within this dataset has been meticulously annotated for toxicity, severity, and sentiment labels. We have developed an advanced Multimodal Multitask framework built for Toxicity detection in Video Content by leveraging Language Models (LMs), crafted for the primary objective along with the additional tasks of conducting sentiment and severity analysis. ToxVidLM incorporates three key modules – the Encoder module, Cross-Modal Synchronization module, and Multitask module – crafting a generic multimodal LM customized for intricate video classification tasks. Our experiments reveal that incorporating multiple modalities from the videos substantially enhances the performance of toxic content detection by achieving an Accuracy and Weighted F1 score of 94.29% and 94.35%, respectively.
Anthology ID:
2024.findings-acl.663
Volume:
Findings of the Association for Computational Linguistics ACL 2024
Month:
August
Year:
2024
Address:
Bangkok, Thailand and virtual meeting
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
11130–11142
Language:
URL:
https://aclanthology.org/2024.findings-acl.663
DOI:
10.18653/v1/2024.findings-acl.663
Bibkey:
Cite (ACL):
Krishanu Maity, A.s. Poornash, Sriparna Saha, and Pushpak Bhattacharyya. 2024. ToxVidLM: A Multimodal Framework for Toxicity Detection in Code-Mixed Videos. In Findings of the Association for Computational Linguistics ACL 2024, pages 11130–11142, Bangkok, Thailand and virtual meeting. Association for Computational Linguistics.
Cite (Informal):
ToxVidLM: A Multimodal Framework for Toxicity Detection in Code-Mixed Videos (Maity et al., Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-acl.663.pdf