CultureVidBench: Benchmarking Cultural Understanding in Text-to-Video Generation

Xianjing Han, Yuhan SU, Yang Deng, Dong Ma, Wee Peng Tay, Bin Zhu


Abstract
Text-to-video (T2V) generation models have advanced rapidly, yet their ability to represent diverse cultural contexts remains underexplored. Existing benchmarks mainly focus on perceptual quality, physical plausibility, and text-video alignment, but do not directly assess whether generated videos capture culturally specific objects, actions, rituals, visible text, or audio cues. We introduce CultureVidBench, a comprehensive benchmark for evaluating cultural understanding in T2V generation. CultureVidBench contains 1,000 curated prompts covering 12 countries, 6 continents, 8 cultural regions, and 14 cultural aspects organized into three categories: material culture, social practice & performance, and ritual & ceremony. Designed specifically for video generation, CultureVidBench emphasizes dynamic and multimodal cultural representation, including social interactions, ritual procedure, and culturally appropriate visible text and audio. We evaluate seven representative T2V models through human user studies and MLLM-based automatic assessment across cultural faithfulness, multimodal cultural rendering, semantic adherence, and perceptual quality. Results show that although current models achieve strong semantic adherence and visual quality, they often fail to faithfully capture fine-grained cultural details, particularly for underrepresented regions, rituals, and multimodal cultural cues.
Anthology ID:
2026.emnlp-main.2191
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
49814–49832
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2191/
DOI:
Bibkey:
Cite (ACL):
Xianjing Han, Yuhan SU, Yang Deng, Dong Ma, Wee Peng Tay, and Bin Zhu. 2026. CultureVidBench: Benchmarking Cultural Understanding in Text-to-Video Generation. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 49814–49832, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
CultureVidBench: Benchmarking Cultural Understanding in Text-to-Video Generation (Han et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2191.pdf