Leveraging a Cognitive Model to Measure Subjective Similarity of Human and GPT-4 Written Content

Tyler Malloy, Maria José Ferreira, Fei Fang, Cleotilde Gonzalez


Abstract
Cosine similarity between two documents can be computed using token embeddings formed by Large Language Models (LLMs) such as GPT-4, and used to categorize those documents across a range of uses. However, these similarities are ultimately dependent on the corpora used to train these LLMs, and may not reflect subjective similarity of individuals or how their biases and constraints impact similarity metrics. This lack of cognitively-aware personalization of similarity metrics can be particularly problematic in educational and recommendation settings where there is a limited number of individual judgements of category or preference, and biases can be particularly relevant. To address this, we rely on an integration of an Instance-Based Learning (IBL) cognitive model with LLM embeddings to develop the Instance-Based Individualized Similarity (IBIS) metric. This similarity metric is beneficial in that it takes into account individual biases and constraints in a manner that is grounded in the cognitive mechanisms of decision making. To evaluate the IBIS metric, we also introduce a dataset of human categorizations of emails as being either dangerous (phishing) or safe (ham). This dataset is used to demonstrate the benefits of leveraging a cognitive model to measure the subjective similarity of human participants in an educational setting.
Anthology ID:
2024.conll-1.40
Volume:
Proceedings of the 28th Conference on Computational Natural Language Learning
Month:
November
Year:
2024
Address:
Miami, FL, USA
Editors:
Libby Barak, Malihe Alikhani
Venue:
CoNLL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
517–527
Language:
URL:
https://aclanthology.org/2024.conll-1.40
DOI:
Bibkey:
Cite (ACL):
Tyler Malloy, Maria José Ferreira, Fei Fang, and Cleotilde Gonzalez. 2024. Leveraging a Cognitive Model to Measure Subjective Similarity of Human and GPT-4 Written Content. In Proceedings of the 28th Conference on Computational Natural Language Learning, pages 517–527, Miami, FL, USA. Association for Computational Linguistics.
Cite (Informal):
Leveraging a Cognitive Model to Measure Subjective Similarity of Human and GPT-4 Written Content (Malloy et al., CoNLL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.conll-1.40.pdf