Lei Wei
Author directory2026
Modality Fault Lines: Structural Corruptions Reveal Fragile Omni-Modal Reasoning
Zhaolu Kang | Meixin Wu | Yu Xue | Yingjie He | Qiming Shi | Lei Wei | Yidi Wang | Richeng Xuan | Zhichao Hu
Findings of the Association for Computational Linguistics: EMNLP 2026
Zhaolu Kang | Meixin Wu | Yu Xue | Yingjie He | Qiming Shi | Lei Wei | Yidi Wang | Richeng Xuan | Zhichao Hu
Findings of the Association for Computational Linguistics: EMNLP 2026
Omni-modal large language models are increasingly evaluated on clean text–vision–audio inputs, where every channel is present, synchronized, and readily interpretable. Such scores are often taken as evidence of robust cross-modal fusion, but clean evaluation cannot tell whether success depends on stable cross-modal structure or on cues sufficient only in intact inputs. To address this gap, we define a modality fault line: a boundary at which model behavior becomes unstable when a modality remains present and human-interpretable, but its internal evidence structure is perturbed. We introduce SCEval (Structure-Corruption Evaluation) a diagnostic evaluation protocol that keeps the question, answer space, and modality channels fixed while applying controlled structural corruptions to text, vision, and audio individually and jointly. Built from 273 human-verified tri-modal examples from Social-IQ, OmniBench, and VALOR, SCEval evaluates 15 proprietary and open-source omni-modal systems. The results show that structural corruption lowers clean accuracy, text–vision damage forms the most stable shared fault line, and multi-modal degradation is non-additive rather than a simple function of the number of corrupted modalities. Clean omni-modal accuracy therefore does not establish that a model will remain reliable when cross-modal evidence becomes structurally unreliable.
Causal Abstention for Cost-Aware Language-Agent Collaboration
Lei Wei | Ruiyang Huang | Zhaolu Kang | Qi Liu | Xiao Peng | Haoran Liu | Zonghao Ying | Haoyu Wang | Ye Shen | Xu Dong | Hongyu Li | Kesu Wang | Yukun Lian | Sicong Xie
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Lei Wei | Ruiyang Huang | Zhaolu Kang | Qi Liu | Xiao Peng | Haoran Liu | Zonghao Ying | Haoyu Wang | Ye Shen | Xu Dong | Hongyu Li | Kesu Wang | Yukun Lian | Sicong Xie
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Multi-agent language systems are often deployed under the assumption that collaboration improves reasoning quality, but this assumption breaks down once token cost, latency, and collaboration-induced errors enter the picture. We study protocol selection under a cost-aware utility objective, where the system decides on each input whether to run a collaborative protocol or fall back to solo reasoning. We propose Causal Advantage Routing for Language agents (CARL), a contextual-bandit framework that estimates the conditional collaboration advantage of each protocol over solo reasoning. CARL combines confounded execution logs with budgeted randomized probes, forms one-vs-solo doubly robust scores and shrunken DR-derived pseudo-outcomes, and at deployment uses a one-sided predictive lower bound for a future realized protocol-solo contrast, otherwise abstaining to solo execution. Across math, code, and multi-hop question-answering benchmarks with an open-weight model, CARL improves cost-aware utility and substantially reduces harmful collaboration over fixed protocols, compute-matched solo strategies, MAS routers, cascade methods, and causal routing baselines, indicating that effective multi-agent systems should estimate when collaboration is causally worth its cost rather than invoking it by default.
Out of Sight, Not Out of Mind: Unveiling Latent Attack in Latent-based Multi-Agent Systems
Chenxi Wang | Ruiyang Huang | Jiayan Sun | Lei Wei | Yifan Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Chenxi Wang | Ruiyang Huang | Jiayan Sun | Lei Wei | Yifan Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Latent-based multi-agent systems replace parts of explicit inter-agent communication with hidden representations, offering a new direction for efficient and flexible agent collaboration. However, moving coordination into latent space may also move attacks beyond the reach of visible-text inspection. In this paper, we study whether latent states can carry attack-associated information that remains effective during clean executions. To examine this question, we introduce a latent attack framework that reactivates attack-induced effects through latent interventions without reusing adversarial text. Extensive experiments show that the resulting latent attacks can substantially degrade task performance in clean executions, especially when applied to inter-agent KV-cache handoffs rather than local hidden states. Further control analyses indicate that this degradation cannot be reduced to arbitrary perturbations or invalid generation. Overall, our findings suggest that latent-based collaboration does not remove attack risk; it shifts part of the risk into less observable execution states, calling for safeguards beyond visible-text inspection.
Plans You Can Check: Verifier-Grounded Learning of an Open-Weight Planner for Executable Video-Editing
Haoyu Wang | Cheng Feng | Liuyang Bian | Ruiyang Huang | Lei Wei | Yafei Wen | Xiaoxin Chen | Xiaoying Tang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Haoyu Wang | Cheng Feng | Liuyang Bian | Ruiyang Huang | Lei Wei | Yafei Wen | Xiaoxin Chen | Xiaoying Tang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Practical video editing is not only pixel generation: an editor must turn a brief, a clip pool, music metadata, and hard constraints into an executable timeline. We study this decision layer as executable video-editing planning and introduce RefineCut, which, unlike workflow systems that wrap a prompted frontier model, trains a compact open-weight planner for it. The planner edits a typed timeline through structured patches covering clip selection, trimming, ordering, transitions, and duration and music alignment; a deterministic verifier applies each patch and checks it against an explicit constraint ledger. Because editing has no single ground-truth repair, we do not imitate teachers directly: RefineCut replays every multi-teacher branch through the verifier and keeps verifier-best repairs as supervision. A second stage, RefineCut-Evo, lets the student score its own repairs with the verifier and a task rubric and trains on high-margin preference pairs, so the final 8B planner runs in a closed verifier loop with no teacher calls at inference. On RefineCut-Bench (3,578 tasks, 7,971 captioned clips, 499 music tracks, explicit ledgers), verifier-replayed distillation lifts the planner from 0.620 to 0.858 on the protocol-specific Video-Editing Score and RefineCut-Evo reaches 0.924; the gain transfers to Llama-3.1-8B and GLM-4-9B, and in the same closed loop the 8B planner matches or exceeds its frontier teachers. Code and RefineCut-Bench are publicly released; see the Data Availability statement.
JPO: Juris Policy Optimization for Structured Legal Reasoning in Criminal Judgment Prediction
Zhaolu Kang | Yantao Liu | Tailong Luo | Leqi Zheng | Lei Wei | Chenghua Zhu | Junhao Gong | Jiachen Qian | Eric Hanchen Jiang | Jiaxin Liu | Yuan Wang | Hao Zhang | Zixia Wang | Rong Fu | Zheng Lin | Richeng Xuan | Zhichao Hu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zhaolu Kang | Yantao Liu | Tailong Luo | Leqi Zheng | Lei Wei | Chenghua Zhu | Junhao Gong | Jiachen Qian | Eric Hanchen Jiang | Jiaxin Liu | Yuan Wang | Hao Zhang | Zixia Wang | Rong Fu | Zheng Lin | Richeng Xuan | Zhichao Hu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Criminal judgment prediction requires models to infer statutory articles, charges, and sentencing outcomes from case facts. Unlike standard classification tasks, it involves a structured reasoning process in which statutes should be matched with facts, charges should be justified by statutes, and sentencing outcomes should remain consistent with charges. Existing approaches optimize final labels, and while some have attempted to evaluate reasoning quality, their evaluations are indirect, often relying on LLM-generated rubrics that reflect model-internal preferences rather than the inherent logical structure of legal adjudication. We propose Juris Policy Optimization (JPO), a post-training framework for structured legal reasoning in Chinese criminal judgment prediction. JPO first uses teacher-generated rationales to supervise a standardized four-step reasoning process, and then applies reinforcement learning with a composite reward over legal prediction quality, reasoning structure completeness, and cross-step consistency. JPO further introduces token-level advantage reweighting and adaptive clipping for legally salient reasoning segments. Experiments on multiple open-source language models and three Chinese legal benchmarks show that JPO consistently improves both judgment prediction and reasoning quality over supervised fine-tuning and reinforcement learning baselines.
PACE: Predictive Adaptive Context Extraction for Long-Horizon LLM Agents
Lei Wei | Xiao Peng | Tt | Guannan Zhang | Chenhao Jiang | Hongyu Li | Lanbo Lin | Yuanwu Xu | Jiayao Liu | Kesu Wang | Bin Wang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Lei Wei | Xiao Peng | Tt | Guannan Zhang | Chenhao Jiang | Hongyu Li | Lanbo Lin | Yuanwu Xu | Jiayao Liu | Kesu Wang | Bin Wang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large Language Model (LLM) agents struggle with ultra-long-horizon tasks requiring hundreds or thousands of interaction steps. Traditional context management approaches face a fundamental dilemma: preserving complete histories rapidly exhausts context windows and forces crude truncation, while aggressive summarization discards critical information prematurely. We propose Predictive Adaptive Context Extraction (PACE), a novel framework that reconceptualizes context management as a Next Step Prediction problem. Inspired by neural attention, PACE dynamically constructs context by adjusting historical memory granularity based on its predicted relevance for the next action. Comprehensive evaluation across diverse benchmarks and models demonstrates that PACE consistently improves task success rates, with larger gains on complex tasks and robust cross-lingual performance. Crucially, PACE enables agents to sustain effective reasoning for 4,897 interaction steps in ultra-long-horizon scenarios, achieving a 66.2 improvement over the full-context ReAct baseline and 5.1 over advanced folding baselines. This fundamentally advances the capability of LLM-based agents in previously intractable long-horizon scenarios. Our code and data are available at https://anonymous.4open.science/r/PACE-B000/.
Search
Fix author
Co-authors
- Ruiyang Huang 3
- Zhaolu Kang 3
- Zhichao Hu 2
- Hongyu Li 2
- Xiao Peng 2
- Tt 2
- Haoyu Wang 2
- Kesu Wang 2
- Richeng Xuan 2
- Liuyang Bian 1
- Xiaoxin Chen (陈晓昕) 1
- Xu Dong 1
- Cheng Feng 1
- Rong Fu 1
- Junhao Gong 1
- Yingjie He 1
- Chenhao Jiang 1
- Eric Hanchen Jiang 1
- Yukun Lian 1
- Lanbo Lin 1
- Zheng Lin 1
- Haoran Liu 1
- Jiaxin Liu 1
- Jiayao Liu 1
- Qi Liu 1
- Yantao Liu 1
- Tailong Luo 1
- Jiachen Qian 1
- Ye Shen 1
- Qiming Shi 1
- Jiayan Sun 1
- Xiaoying Tang 1
- Bin Wang 1
- Chenxi Wang 1
- Yidi Wang 1
- Yuan Wang 1
- Zixia Wang 1
- Yafei Wen 1
- Meixin Wu 1
- Yifan Wu 1
- Yuanwu Xu 1
- Yu Xue 1
- Zonghao Ying 1
- Guannan Zhang 1
- Hao Zhang 1
- Leqi Zheng 1
- Chenghua Zhu 1