Neeka Motamedrasa
Author directory2026
Representational Similarity Alignment of Figurative Language in Humans and Large Language Models
Samhita Bollepally | Aurora Sloman-Moll | Takashi Yamauchi | Neeka Motamedrasa
Proceedings of the 3rd Workshop on Language Understanding in the Human-Machine Era (LUHME 2026)
Samhita Bollepally | Aurora Sloman-Moll | Takashi Yamauchi | Neeka Motamedrasa
Proceedings of the 3rd Workshop on Language Understanding in the Human-Machine Era (LUHME 2026)
Large language models (LLMs) often produce judgments similar to those of humans, but their interpretation of figurative language remains unclear. We compared human participants and four instruction-tuned LLMs (GPT-4, Gemma-2-9B, Llama-3.2, and Mistral-7B) on their ratings of 240 dialogue-based sentences spanning six linguistic traits: conventionality, sarcasm, funny, emotion, idiomacy, and Gen Z slang. While humans and LLMs aligned strongly at the surface level, differences emerged in representational similarity patterns, particularly for idiomacy and Gen Z slang. GPT-4 showed the closest alignment to humans, though all models differed at the representational level, suggesting that similar outputs may arise from different underlying language representations. We also examined the relationship between model scale and representational similarity using the Gemma model series (Gemma-2-9B-IT, Gemma-3-27B-IT, and Gemma-4-31B-IT), and found that representational similarity patterns were largely unaffected by model size.