Representing Human Values in Argumentation: A Linguistically Grounded Comparison of Lexicons, Embeddings, and LLMs

Chaya Liebeskind, Barbara Lewandowska-Tomaszczyk, Shmuel Liebeskind


Abstract
Human values are enduring motivational principles that shape how people argue, justify, and evaluate social issues. While prior work has largely approached value detection as a standard classification problem, we investigate what values look like linguistically and whether computational models reflect aspects of the structure proposed by Schwartz’s theory of basic human values. Using the training partition of the Touché ValueEval corpus, we compare lexical resources, linguistic markers, supervised classifiers over TF–IDF and sentence embeddings, an automated model-search procedure, a zero-shot large language model (Gemini 3.5 Flash), and a transformer embedding baseline (all-MiniLM-L6-v2). On a shared 124-item test split, the three dense semantic approaches form a statistically indistinguishable high-performing tier (macro-F1 0.529–0.591) and achieve substantially higher scores than the sparse lexical methods, highlighting the importance of contextual semantic representation in this setting. A constructed diagnostic sanity check shows that deontic modals, universal quantifiers, and abstract nouns behave in the expected direction for value-bearing versus opinion language; however, these cues provide little information for distinguishing individual values in the Touché data. Performance is less stable for low-support value categories. Qualitative inspection of model confusions reveals several patterns consistent with theoretically close Schwartz values, alongside confusions between more distant categories; circumplex adjacency is not formally tested. Overall, the results suggest a distinction between surface linguistic cues associated with value-bearing language and the contextual semantic information involved in distinguishing specific values, while offering qualitative evidence that some model confusions align with relationships in Schwartz’s motivational structure.
Anthology ID:
2026.luhme-1.15
Volume:
Proceedings of the 3rd Workshop on Language Understanding in the Human-Machine Era (LUHME 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Rui Sousa-Silva, Henrique Lopes Cardoso, Maarit Koponen, Antonio Pareja-Lora
Venues:
LUHME | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
183–196
Language:
URL:
https://aclanthology.org/2026.luhme-1.15/
DOI:
Bibkey:
Cite (ACL):
Chaya Liebeskind, Barbara Lewandowska-Tomaszczyk, and Shmuel Liebeskind. 2026. Representing Human Values in Argumentation: A Linguistically Grounded Comparison of Lexicons, Embeddings, and LLMs. In Proceedings of the 3rd Workshop on Language Understanding in the Human-Machine Era (LUHME 2026), pages 183–196, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Representing Human Values in Argumentation: A Linguistically Grounded Comparison of Lexicons, Embeddings, and LLMs (Liebeskind et al., LUHME 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.luhme-1.15.pdf