Capturing Topic Framing via Masked Language Modeling

Xiaobo Guo, Weicheng Ma, Soroush Vosoughi


Abstract
Differential framing of issues can lead to divergent world views on important issues. This is especially true in domains where the information presented can reach a large audience, such as traditional and social media. Scalable and reliable measurement of such differential framing is an important first step in addressing them. In this work, based on the intuition that framing affects the tone and word choices in written language, we propose a framework for modeling the differential framing of issues through masked token prediction via large-scale fine-tuned language models (LMs). Specifically, we explore three key factors for our framework: 1) prompt generation methods for the masked token prediction; 2) methods for normalizing the output of fine-tuned LMs; 3) robustness to the choice of pre-trained LMs used for fine-tuning. Through experiments on a dataset of articles from traditional media outlets covering five diverse and politically polarized topics, we show that our framework can capture differential framing of these topics with high reliability.
Anthology ID:
2022.findings-emnlp.507
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2022
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates
Editors:
Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6811–6825
Language:
URL:
https://aclanthology.org/2022.findings-emnlp.507
DOI:
10.18653/v1/2022.findings-emnlp.507
Bibkey:
Cite (ACL):
Xiaobo Guo, Weicheng Ma, and Soroush Vosoughi. 2022. Capturing Topic Framing via Masked Language Modeling. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 6811–6825, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
Capturing Topic Framing via Masked Language Modeling (Guo et al., Findings 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.findings-emnlp.507.pdf
Video:
 https://aclanthology.org/2022.findings-emnlp.507.mp4