When Cultures Move: Measuring and Improving Multicultural Text-to-Video Generation

Shuowei Li, Yuming Zhao, Parth Bhalerao, Oana Ignat


Abstract
Text-to-video (T2V) generation has achieved strong visual fidelity, yet its ability to represent multiple cultures within a single scene remains largely unexplored, a gap with real consequences as generative video becomes a mainstream medium for cultural storytelling. We introduce multicultural text-to-video generation as a new task and present the first benchmark designed to study this setting: 243 culturally grounded prompts and 972 videos, spanning three cultures (Chinese, American, Romanian), three action categories, and both mono-cultural and cross-cultural scenarios. Using this benchmark, we analyze how current T2V models represent culture with CLIP-based metrics, VLM-as-judge assessments, and video quality measures. As one strategy for improving cultural fidelity, we explore MAVEN, which decomposes prompts into person, action, and location dimensions, each handled by a culturally specialized agent in parallel or sequentially. In our controlled setting, parallel specialization achieves the strongest cultural relevance while maintaining visual quality and temporal consistency, suggesting that structured prompt refinement is a promising direction for multicultural T2V generation. We release our dataset and code at: https://github.com/AIM-SCU/MAVEN.
Anthology ID:
2026.nlp4pi-1.42
Volume:
Proceedings of the Fifth Workshop on NLP for Positive Impact (NLP4PI)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Katherine Atwell, Angana Borah, Daryna Dementieva, Elisa Kreiss, Neema Kotonya, Jiarui Liu, Liz Olson, Ruyuan Wan, Jieyu Zhao
Venues:
NLP4PI | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
575–591
Language:
URL:
https://aclanthology.org/2026.nlp4pi-1.42/
DOI:
Bibkey:
Cite (ACL):
Shuowei Li, Yuming Zhao, Parth Bhalerao, and Oana Ignat. 2026. When Cultures Move: Measuring and Improving Multicultural Text-to-Video Generation. In Proceedings of the Fifth Workshop on NLP for Positive Impact (NLP4PI), pages 575–591, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
When Cultures Move: Measuring and Improving Multicultural Text-to-Video Generation (Li et al., NLP4PI 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.nlp4pi-1.42.pdf