Culturally-Aware Alignment for Multimodal Models via Group Reward Optimization for Southeast Asia

Longyin Zhang, Shuo Sun, Yingxu He, Won Cheng Yi Lewis, Bowei Zou, AiTi Aw


Abstract
Multimodal large language models (MLLMs) perform well across many tasks but often exhibit Western bias, limiting their effectiveness in regions such as Southeast Asia (SEA). In this work, we study how both evaluation and model design can be better adapted to the linguistic and cultural characteristics of this region. We present the SEA-Omni Benchmark Suite, which brings together a set of SEA-focused image and video datasets capturing phenomena such as intra-sentential code-switching and culturally grounded multimodal cues. Alongside these benchmarks, we develop MERaLiON-Omni-10B, an omni-perception model trained with a progressive, data-efficient pipeline that moves from vision-language alignment to more advanced multimodal fusion. To better account for region-specific cultural signals, we study text-mediated cultural alignment in SEA multimodal settings using GRPO to surface culturally distinctive responses that are often suppressed by generic decoding strategies. We introduce a fact-anchored dual-reward mechanism to balance cultural richness with multimodal consistency in which cultural density is measured via localized knowledge entities of generated texts, and multimodal coherence is assessed against silver textual descriptions of the multimodal input. Experimental results indicate that the resulting model performs strongly on SEA benchmarks while maintaining reasonable general capabilities.
Anthology ID:
2026.emnlp-main.863
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
19969–19988
Language:
URL:
https://aclanthology.org/2026.emnlp-main.863/
DOI:
Bibkey:
Cite (ACL):
Longyin Zhang, Shuo Sun, Yingxu He, Won Cheng Yi Lewis, Bowei Zou, and AiTi Aw. 2026. Culturally-Aware Alignment for Multimodal Models via Group Reward Optimization for Southeast Asia. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 19969–19988, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Culturally-Aware Alignment for Multimodal Models via Group Reward Optimization for Southeast Asia (Zhang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.863.pdf