Shuowei Li

Author directory

2026

Text-to-video (T2V) generation has achieved strong visual fidelity, yet its ability to represent multiple cultures within a single scene remains largely unexplored, a gap with real consequences as generative video becomes a mainstream medium for cultural storytelling. We introduce multicultural text-to-video generation as a new task and present the first benchmark designed to study this setting: 243 culturally grounded prompts and 972 videos, spanning three cultures (Chinese, American, Romanian), three action categories, and both mono-cultural and cross-cultural scenarios. Using this benchmark, we analyze how current T2V models represent culture with CLIP-based metrics, VLM-as-judge assessments, and video quality measures. As one strategy for improving cultural fidelity, we explore MAVEN, which decomposes prompts into person, action, and location dimensions, each handled by a culturally specialized agent in parallel or sequentially. In our controlled setting, parallel specialization achieves the strongest cultural relevance while maintaining visual quality and temporal consistency, suggesting that structured prompt refinement is a promising direction for multicultural T2V generation. We release our dataset and code at: https://github.com/AIM-SCU/MAVEN.
Large language models (LLMs) often need to balance their internal parametric knowledge with external information, such as user beliefs and content from retrieved documents, in real-world scenarios like RAG or chat-based systems. A model’s ability to reliably process these sources is key to system safety. Previous studies on knowledge conflict and sycophancy are limited to a binary conflict paradigm, primarily exploring conflicts between parametric knowledge and either a document or a user, but ignoring the interactive environment where all three sources exist simultaneously. To fill this gap, we propose a three-source interaction framework and systematically evaluate 27 LLMs from 3 families on 2 datasets. Our findings reveal general patterns: most models rely more on document assertions than user assertions, and this preference is reinforced by post-training. Furthermore, our behavioral analysis shows that most models are impressionable, unable to effectively discriminate between helpful and harmful external information. To address this, we demonstrate that fine-tuning on diverse source interaction data can significantly increase a model’s discrimination abilities. In short, our work paves the way for developing trustworthy LLMs that can effectively and reliably integrate multiple sources of information. Code is available at https://github.com/shuowl/llm-source-balancing.

2025

Retrieval-Augmented Generation (RAG) has recently gained significant attention for its enhanced ability to integrate external knowledge sources into open-domain question answering (QA) tasks. However, it remains unclear how these models address fairness concerns, particularly with respect to sensitive attributes such as gender, geographic location, and other demographic factors. First, as language models evolve to prioritize utility, like improving exact match accuracy, fairness considerations may have been largely overlooked. Second, the complex, multi-component architecture of RAG methods poses challenges in identifying and mitigating biases, as each component is optimized for distinct objectives. In this paper, we aim to empirically evaluate fairness in several RAG methods. We propose a fairness evaluation framework tailored to RAG, using scenario-based questions and analyzing disparities across demographic attributes. Our experimental results indicate that, despite recent advances in utility-driven optimization, fairness issues persist in both the retrieval and generation stages. These findings underscore the need for targeted interventions to address fairness concerns throughout the RAG pipeline. The dataset and code used in this study are publicly available at this GitHub Repository.