Webis @ ImageArg 2023: Embedding-based Stance and Persuasiveness Classification

Islam Torky, Simon Ruth, Shashi Sharma, Mohamed Salama, Krishna Chaitanya, Tim Gollub, Johannes Kiesel, Benno Stein


Abstract
This paper reports on the submissions of Webis to the two subtasks of ImageArg 2023. For the subtask of argumentative stance classification, we reached an F1 score of 0.84 using a BERT model for sequence classification. For the subtask of image persuasiveness classification, we reached an F1 score of 0.56 using CLIP embeddings and a neural network model, achieving the best performance for this subtask in the competition. Our analysis reveals that seemingly clear sentences (e.g., “I support gun control”) are still problematic for our otherwise competitive stance classifier and that ignoring the tweet text for image persuasiveness prediction leads to a model that is similarly effective to our top-performing model.
Anthology ID:
2023.argmining-1.16
Volume:
Proceedings of the 10th Workshop on Argument Mining
Month:
December
Year:
2023
Address:
Singapore
Editors:
Milad Alshomary, Chung-Chi Chen, Smaranda Muresan, Joonsuk Park, Julia Romberg
Venues:
ArgMining | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
157–161
Language:
URL:
https://aclanthology.org/2023.argmining-1.16
DOI:
10.18653/v1/2023.argmining-1.16
Bibkey:
Cite (ACL):
Islam Torky, Simon Ruth, Shashi Sharma, Mohamed Salama, Krishna Chaitanya, Tim Gollub, Johannes Kiesel, and Benno Stein. 2023. Webis @ ImageArg 2023: Embedding-based Stance and Persuasiveness Classification. In Proceedings of the 10th Workshop on Argument Mining, pages 157–161, Singapore. Association for Computational Linguistics.
Cite (Informal):
Webis @ ImageArg 2023: Embedding-based Stance and Persuasiveness Classification (Torky et al., ArgMining-WS 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.argmining-1.16.pdf
Video:
 https://aclanthology.org/2023.argmining-1.16.mp4