Trait Collapse in Text-to-Image Generation: Evaluating and Mitigating Personality Inconsistency in Visual Storytelling

Yuanbo Tong, Haoyuan Li, Jibiao Jiang, Zirui Wang, Yuchen Li, Jiamou Liu


Abstract
In visual storytelling, a believable character must not only look consistent across scenes but also behave in ways that reflect their personality. Current text-to-image (T2I) models preserve visual appearance effectively, yet consistently fail to maintain personality-relevant behavior—a failure we term trait collapse. We show that conventional metrics (CLIP Score, DINO similarity) are blind to this failure, and that abstract personality descriptors yield no reliable improvement over neutral prompts regardless of abstraction level. To systematically diagnose trait collapse, we introduce ViStoryBench-Personality, a story-level benchmark combining an expert-validated Visual Cues Lexicon (Fleiss’ 𝜅 = 0.757) with a six-dimensional metric suite covering personality alignment, cross-scene stability, and behavioral coherence. Evaluating seven T2I systems, we confirm a persistent semantic gap between abstract trait labels and visual evidence, and find that visual identity consistency does not imply personality consistency. To bridge this gap, we propose Trait-Behavior-Visual (TBV), a training-free prompting framework that decomposes personality traits into renderable visual constraints. TBV improves Personality Alignment Score by up to +22.1 %, with larger gains in models with stronger language-conditioning capacity.
Anthology ID:
2026.emnlp-main.362
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
8281–8306
Language:
URL:
https://aclanthology.org/2026.emnlp-main.362/
DOI:
Bibkey:
Cite (ACL):
Yuanbo Tong, Haoyuan Li, Jibiao Jiang, Zirui Wang, Yuchen Li, and Jiamou Liu. 2026. Trait Collapse in Text-to-Image Generation: Evaluating and Mitigating Personality Inconsistency in Visual Storytelling. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 8281–8306, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Trait Collapse in Text-to-Image Generation: Evaluating and Mitigating Personality Inconsistency in Visual Storytelling (Tong et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.362.pdf