N24News: A New Dataset for Multimodal News Classification

Zhen Wang, Xu Shan, Xiangxie Zhang, Jie Yang


Abstract
Current news datasets merely focus on text features on the news and rarely leverage the feature of images, excluding numerous essential features for news classification. In this paper, we propose a new dataset, N24News, which is generated from New York Times with 24 categories and contains both text and image information in each news. We use a multitask multimodal method and the experimental results show multimodal news classification performs better than text-only news classification. Depending on the length of the text, the classification accuracy can be increased by up to 8.11%. Our research reveals the relationship between the performance of a multimodal classifier and its sub-classifiers, and also the possible improvements when applying multimodal in news classification. N24News is shown to have great potential to prompt the multimodal news studies.
Anthology ID:
2022.lrec-1.729
Volume:
Proceedings of the Thirteenth Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
6768–6775
Language:
URL:
https://aclanthology.org/2022.lrec-1.729
DOI:
Bibkey:
Cite (ACL):
Zhen Wang, Xu Shan, Xiangxie Zhang, and Jie Yang. 2022. N24News: A New Dataset for Multimodal News Classification. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 6768–6775, Marseille, France. European Language Resources Association.
Cite (Informal):
N24News: A New Dataset for Multimodal News Classification (Wang et al., LREC 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.lrec-1.729.pdf
Code
 billywzh717/n24news
Data
N15NewsAG NewsFakeddit