Yufeng Wu
2025
Embodiment in Multimodal Semantics: Comparing Sensory, Emotional, and Visual Features in Chinese Color Metaphors
Yufeng Wu
|
Meichun Liu
Proceedings of the 37th Conference on Computational Linguistics and Speech Processing (ROCLING 2025)
This study examines how sensory-motor experience, emotional valence and arousal, and visual image statistics contribute to multimodal alignment in Chinese color metaphors. Using 184 metaphorical lexemes from six basic color terms, we combined textual data from the Chinese Corpus Internet (CCI 3.0) with image sets from Baidu, embedding both with Chinese-CLIP and measuring alignment via cosine similarity. Sensory-motor ratings, particularly effector exclusivity and tactile strength, correlated negatively with alignment, while emotional valence showed strong positive correlations and visual features such as color variability and entropy contributed positively. Regression and importance analyses confirmed emotion as the most reliable predictor, with sensory ratings offering little explanatory power. The findings indicate that affective salience and perceptual richness, rather than generalized sensory norms, are central to the embodied grounding of metaphorical words in multimodal contexts.