Chun Wei Chen
Author directoryAlso published as: Chun-Wei Chen
2026
Tri-PvP: Exposing Modality Bias in Omni-Modal Large Language Models through Perceptual-Propositional Evidence Conflicts
Yen-Ting Piao | Shu-Yun Chen | Chin-Hui Chu | Chun-Wei Chen | Shih-Yun Shan Kuan | Hung-yi Lee | Yun-Nung Chen
Findings of the Association for Computational Linguistics: EMNLP 2026
Yen-Ting Piao | Shu-Yun Chen | Chin-Hui Chu | Chun-Wei Chen | Shih-Yun Shan Kuan | Hung-yi Lee | Yun-Nung Chen
Findings of the Association for Computational Linguistics: EMNLP 2026
Omni-modal large language models (OLLMs) jointly process vision, audio, and text, yet their modality bias under cross-modal conflict remains underexplored. Existing benchmarks conflate two distinct forms of evidence within a single modality: perceptual signals (e.g., a photograph or recording of a dog) and propositional signals (e.g., the declarative claim "this is a dog"), such that any measured modality bias is inherently confounded with evidence-form bias, precluding clean attribution to either source. To address this, we introduce Tri-PvP, an 8,000-sample tri-modal conflict benchmark crossing vision, audio, and text, where vision and audio each take perceptual or propositional form. Evaluating five OLLMs, we find robust visual bias across most models and evidence-type conditions. Crucially, we reveal a systematic asymmetry in evidence-form bias: models exhibit a stronger bias toward perceptual signal in vision but propositional in audio. Further analyses via layer-wise linear probing and contrastive decoding reveal that modality bias is already linearly decodable from early representation layers and can only be partially mitigated, calling for mitigation strategies beyond surface-level interventions.
An Exploration of Mamba for Speech Self-Supervised Models
Tzu-Quan Lin | Heng-Cheng Kuo | Tzu-Chieh Wei | Hsi-Chun Cheng | Chun Wei Chen | Hsien-Fu Hsiao | Yu Tsao | Hung-yi Lee
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Tzu-Quan Lin | Heng-Cheng Kuo | Tzu-Chieh Wei | Hsi-Chun Cheng | Chun Wei Chen | Hsien-Fu Hsiao | Yu Tsao | Hung-yi Lee
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
While Mamba has demonstrated strong performance in language modeling, its potential as a speech self-supervised learning (SSL) model remains underexplored, with prior studies limited to isolated tasks. To address this, we explore Mamba-based HuBERT models as alternatives to Transformer-based SSL architectures. Leveraging the linear-time Selective State Space, these models enable fine-tuning on long-context ASR with significantly lower compute. Moreover, they show superior performance when fine-tuned for streaming ASR. Beyond fine-tuning, these models show competitive performance on SUPERB probing benchmarks, particularly in causal settings. Our analysis shows that they yield higher-quality quantized representations and capture speaker-related features more distinctly than Transformer-based models. These findings highlight Mamba-based SSL as a promising and complementary direction for long-sequence modeling, real-time speech modeling, and speech unit extraction. The codebase is available at https://github.com/hckuo145/Mamba-based-HuBERT.