Yingjie He
Author directory2026
Modality Fault Lines: Structural Corruptions Reveal Fragile Omni-Modal Reasoning
Zhaolu Kang | Meixin Wu | Yu Xue | Yingjie He | Qiming Shi | Lei Wei | Yidi Wang | Richeng Xuan | Zhichao Hu
Findings of the Association for Computational Linguistics: EMNLP 2026
Zhaolu Kang | Meixin Wu | Yu Xue | Yingjie He | Qiming Shi | Lei Wei | Yidi Wang | Richeng Xuan | Zhichao Hu
Findings of the Association for Computational Linguistics: EMNLP 2026
Omni-modal large language models are increasingly evaluated on clean text–vision–audio inputs, where every channel is present, synchronized, and readily interpretable. Such scores are often taken as evidence of robust cross-modal fusion, but clean evaluation cannot tell whether success depends on stable cross-modal structure or on cues sufficient only in intact inputs. To address this gap, we define a modality fault line: a boundary at which model behavior becomes unstable when a modality remains present and human-interpretable, but its internal evidence structure is perturbed. We introduce SCEval (Structure-Corruption Evaluation) a diagnostic evaluation protocol that keeps the question, answer space, and modality channels fixed while applying controlled structural corruptions to text, vision, and audio individually and jointly. Built from 273 human-verified tri-modal examples from Social-IQ, OmniBench, and VALOR, SCEval evaluates 15 proprietary and open-source omni-modal systems. The results show that structural corruption lowers clean accuracy, text–vision damage forms the most stable shared fault line, and multi-modal degradation is non-additive rather than a simple function of the number of corrupted modalities. Clean omni-modal accuracy therefore does not establish that a model will remain reliable when cross-modal evidence becomes structurally unreliable.
How Order-Sensitive Are LLMs? OrderProbe for Deterministic Structural Reconstruction
Zhaolu Kang | Yingjie He | Kehan Jiang | Leqi Zheng | Jiachen Qian | Qianyuan Zhang | Chunlei Meng | Yujie Feng | Yuan Wang | Stephen Dou | Aming Wu | Pengxiang Zhao | Jiaxin Liu | Guansu Wang | Zeyu Zhang | Zeyu Wang | Lei Wang | Qishi Zhan | Xiaomin He | Meisheng Zhang | Jianyuan Ni | Richeng Xuan
Findings of the Association for Computational Linguistics: EMNLP 2026
Zhaolu Kang | Yingjie He | Kehan Jiang | Leqi Zheng | Jiachen Qian | Qianyuan Zhang | Chunlei Meng | Yujie Feng | Yuan Wang | Stephen Dou | Aming Wu | Pengxiang Zhao | Jiaxin Liu | Guansu Wang | Zeyu Zhang | Zeyu Wang | Lei Wang | Qishi Zhan | Xiaomin He | Meisheng Zhang | Jianyuan Ni | Richeng Xuan
Findings of the Association for Computational Linguistics: EMNLP 2026
Large language models (LLMs) excel at semantic understanding, yet their ability to reconstruct internal structure from scrambled inputs remains underexplored. Sentence-level restoration is difficult to evaluate automatically because scrambled sentences often admit multiple valid reorderings. We introduce OrderProbe, a deterministic benchmark for structural reconstruction using fixed four-character expressions in Chinese, Japanese, and Korean, which have a unique canonical order and thus support exact-match scoring. We further propose a diagnostic framework that evaluates models beyond recovery accuracy, including Semantic Accuracy, Logical Validity, Structural Consistency, Robustness, and Information Density. Experiments on twelve widely used LLMs show that structural reconstruction remains difficult even for frontier systems: zero-shot recovery frequently falls below 35%. We also observe a consistent gap between meaning-oriented generation and exact structural reconstruction, suggesting that structural robustness is not an automatic byproduct of semantic competence.