Challenge or Empower: Revisiting Argumentation Quality in a News Editorial Corpus

Roxanne El Baff, Henning Wachsmuth, Khalid Al-Khatib, Benno Stein


Abstract
News editorials are said to shape public opinion, which makes them a powerful tool and an important source of political argumentation. However, rarely do editorials change anyone’s stance on an issue completely, nor do they tend to argue explicitly (but rather follow a subtle rhetorical strategy). So, what does argumentation quality mean for editorials then? We develop the notion that an effective editorial challenges readers with opposing stance, and at the same time empowers the arguing skills of readers that share the editorial’s stance — or even challenges both sides. To study argumentation quality based on this notion, we introduce a new corpus with 1000 editorials from the New York Times, annotated for their perceived effect along with the annotators’ political orientations. Analyzing the corpus, we find that annotators with different orientation disagree on the effect significantly. While only 1% of all editorials changed anyone’s stance, more than 5% meet our notion. We conclude that our corpus serves as a suitable resource for studying the argumentation quality of news editorials.
Anthology ID:
K18-1044
Volume:
Proceedings of the 22nd Conference on Computational Natural Language Learning
Month:
October
Year:
2018
Address:
Brussels, Belgium
Editors:
Anna Korhonen, Ivan Titov
Venue:
CoNLL
SIG:
SIGNLL
Publisher:
Association for Computational Linguistics
Note:
Pages:
454–464
Language:
URL:
https://aclanthology.org/K18-1044
DOI:
10.18653/v1/K18-1044
Bibkey:
Cite (ACL):
Roxanne El Baff, Henning Wachsmuth, Khalid Al-Khatib, and Benno Stein. 2018. Challenge or Empower: Revisiting Argumentation Quality in a News Editorial Corpus. In Proceedings of the 22nd Conference on Computational Natural Language Learning, pages 454–464, Brussels, Belgium. Association for Computational Linguistics.
Cite (Informal):
Challenge or Empower: Revisiting Argumentation Quality in a News Editorial Corpus (El Baff et al., CoNLL 2018)
Copy Citation:
PDF:
https://aclanthology.org/K18-1044.pdf