Who Counts as "the People"? Measuring Contested Political Concepts from Political Speech using Masked Language Models

Hyeongjae Lee, Seonwoo Ahn, Sunwoo Kwak, June Jeon, Jisung Yoon, Taegyoon Kim


Abstract
What do political elites mean when they invoke "the people", and how has this meaning shifted across centuries of democratic history? Political theorists have long held that “the people” is a discursively constructed and contested category. Yet empirical work remains largely qualitative or small in scale, and computational approaches have yet to address how contested concepts themselves are framed over time. We address this gap with a generalizable framework that models contested concepts as configurations of theoretically grounded frames, and apply it to American presidential rhetoric based on three theoretically grounded frames: Nation, Civic, and Global. Leveraging a fine-tuned political masked language model, we mask each occurrence of "people" and score each frame by the pseudo-log-likelihood of its probe words. We apply the framework to 3,402 U.S. presidential speeches from 1789 to 2025. The resulting measurements agree with expert human coding at a level comparable to inter-annotator agreement, while tracking major junctures such as the Civil War, the World Wars, the Civil Rights era, and a recent nationalist turn. They also covary with external indicators as expected: stronger democracy is associated with less national and more civic framing. Beyond "the people", the framework can generalize to other contested political concepts.
Anthology ID:
2026.emnlp-main.879
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
20314–20325
Language:
URL:
https://aclanthology.org/2026.emnlp-main.879/
DOI:
Bibkey:
Cite (ACL):
Hyeongjae Lee, Seonwoo Ahn, Sunwoo Kwak, June Jeon, Jisung Yoon, and Taegyoon Kim. 2026. Who Counts as "the People"? Measuring Contested Political Concepts from Political Speech using Masked Language Models. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 20314–20325, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Who Counts as “the People”? Measuring Contested Political Concepts from Political Speech using Masked Language Models (Lee et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.879.pdf