Yuyin Zhou
Author directoryOther people with similar names: Yuyin Zhou
2026
EntropyPrune: Matrix Entropy Guided Visual Token Pruning for Multimodal Large Language Models
Yahong Wang | Juncheng Wu | Zhangkai Ni | Chengmei Yang | Yihang Liu | Longzhen Yang | Yuyin Zhou | Ying Wen | Lianghua He
Findings of the Association for Computational Linguistics: EMNLP 2026
Yahong Wang | Juncheng Wu | Zhangkai Ni | Chengmei Yang | Yihang Liu | Longzhen Yang | Yuyin Zhou | Ying Wen | Lianghua He
Findings of the Association for Computational Linguistics: EMNLP 2026
Multimodal large language models (MLLMs) incur substantial inference cost due to the processing of hundreds of visual tokens per image. Although token pruning has proven effective for accelerating inference, determining when and where to prune remains largely heuristic. Existing approaches typically rely on static, empirically selected layers, which limit interpretability and transferability across models. In this work, we introduce a matrix-entropy perspective and identify an ”Entropy Collapse Layer”(ECL), where the information content of visual representations exhibits a sharp and consistent drop, which provides a principled criterion for selecting the pruning stage. Building on this observation, we propose EntropyPrune, a novel matrix-entropy-guided token pruning framework that quantifies the information value of individual visual tokens and prunes redundant ones without relying on attention maps. Moreover, to enable efficient computation, we exploit the spectral equivalence of dual Gram matrices, reducing the complexity of entropy computation and yielding up to a 64x theoretical speedup. Extensive experiments on diverse multimodal benchmarks demonstrate that EntropyPrune consistently outperforms established competitive pruning methods in both accuracy and efficiency. On LLaVA-1.5-7B, our method achieves a 57.7% reduction in FLOPs while preserving 98.8% of the original performance. Furthermore, EntropyPrune generalizes effectively to high-resolution and video-based models, highlighting the strong robustness and scalability in practical MLLM acceleration.
Your Agent, Their Asset: A Real-World Safety Analysis of OpenClaw
Zijun Wang | Haoqin Tu | Letian Zhang | Hardy Chen | Juncheng Wu | Xiangyan Liu | Zhenlong Yuan | Tianyu Pang | Qizhe Xie | Fengze Liu | Zeyu Zheng | Huaxiu Yao | Yuyin Zhou | Cihang Xie
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zijun Wang | Haoqin Tu | Letian Zhang | Hardy Chen | Juncheng Wu | Xiangyan Liu | Zhenlong Yuan | Tianyu Pang | Qizhe Xie | Fengze Liu | Zeyu Zheng | Huaxiu Yao | Yuyin Zhou | Cihang Xie
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
OpenClaw, the most widely deployed personal AI agent in early 2026, operates with full local system access and integrates with sensitive services such as Gmail, Stripe, and the filesystem. While these broad privileges enable high levels of automation and powerful personalization, they also expose a substantial attack surface that existing sandboxed evaluations fail to capture. To address this gap, we present the first real-world safety evaluation of OpenClaw and introduce the CIK taxonomy, which unifies an agent’s persistent state into three dimensions, i.e., Capability, Identity, and Knowledge, for safety analysis. Our evaluations cover 12 attack scenarios on a live OpenClaw instance across four backbone models (Claude Sonnet 4.5, Opus 4.6, Gemini 3.1 Pro, and GPT-5.4). The results show that poisoning any single CIK dimension increases the average attack success rate from 24.6% to 64-74%, with even the most robust model exhibiting more than a threefold increase over its baseline vulnerability. We further assess three CIK-aligned defense strategies alongside a file-protection mechanism; however, the strongest defense still yields a 63.8% success rate under Capability-targeted attacks, while file protection blocks 97% of malicious injections but also prevents legitimate updates. Taken together, these findings show that the vulnerabilities are inherent to the agent architecture, necessitating more systematic safeguards to secure personal AI agents. Our project page is https://ucsc-vlaa.github.io/CIK-Bench.
MedFrameQA: A Multi-Image Medical VQA Benchmark for Clinical Reasoning
Suhao Yu | Haojin Wang | Juncheng Wu | Luyang Luo | Jingshen Wang | Cihang Xie | Pranav Rajpurkar | Carl Yang | Yang Yang | Kang Wang | Yannan Yu | Yuyin Zhou
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Suhao Yu | Haojin Wang | Juncheng Wu | Luyang Luo | Jingshen Wang | Cihang Xie | Pranav Rajpurkar | Carl Yang | Yang Yang | Kang Wang | Yannan Yu | Yuyin Zhou
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Real-world clinical practice demands multi-image comparative reasoning, yet current medical benchmarks remain limited to single-frame interpretation. We present MedFrameQA, a video-derived, transcript-grounded benchmark for multi-image reasoning VQA, built from educationally-validated diagnostic sequences. To construct this dataset, we develop a scalable pipeline that leverages narrative transcripts from medical education videos to align visual frames with textual concepts, automatically producing 2,851 high-quality multi-image VQA pairs with explicit, transcript-grounded reasoning chains. Our evaluation of 13 advanced MLLMs (including reasoning models) exposes severe deficiencies in multi-image synthesis, where accuracies mostly fall below 50% and exhibit instability across varying image counts. Error analysis demonstrates that models often treat images as isolated instances, failing to track pathological progression or cross-reference anatomical shifts. MedFrameQA provides a rigorous standard for evaluating the next generation of MLLMs in handling complex, temporally grounded medical narratives.
Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents
Minhua Lin | Juncheng Wu | Zijun Wang | Zhan Shi | Yisi Sang | Bing He | Zewen Liu | Tianxin Wei | Zongyu Wu | Zhiwei Zhang | Dakuo Wang | Xiang Zhang | Benoit Dumoulin | Cihang Xie | Yuyin Zhou | Suhang Wang | Hanqing Lu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Minhua Lin | Juncheng Wu | Zijun Wang | Zhan Shi | Yisi Sang | Bing He | Zewen Liu | Tianxin Wei | Zongyu Wu | Zhiwei Zhang | Dakuo Wang | Xiang Zhang | Benoit Dumoulin | Cihang Xie | Yuyin Zhou | Suhang Wang | Hanqing Lu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
LLM agents are increasingly deployed as systems built around editable external harnesses, including prompts, skills, memories and tools, that shape task execution without changing model parameters. Harness self-evolution adapts such agents by updating these harnesses from execution evidence. Yet it remains unclear whether a model’s base capability in task-solving predicts its capabilities in harness self-evolution: which models produce useful harness updates, and which actually benefit from them? We analyze two harness self-evolution capabilities: (i) harness-updating, the capability to produce useful persistent harness updates from execution evidence; (ii) harness-benefit, the capability to benefit from updated harnesses during task solving. Our analysis reveals two findings. First, harness-updating is flat in base capability: models from different capability tiers produce harness updates that lead to surprisingly similar gains; even Qwen3.5-9B’s updates yields gains comparable to those of Claude Opus 4.6. Second, harness-benefit is non-monotonic in base capability: weak-tier models benefit little from updated harnesses, mid-tier models benefit most, and strong-tier models benefit less than mid-tier. We trace low gains at the weak tier to two failure modes: weak-tier models may fail to activate relevant harness artifacts, or activate them but fail to follow them faithfully. These findings suggest investing capability budget in the task-solving agent rather than the evolver, and targeting harness invocation and long-horizon instruction following in agent training. Our source code is publicly available at https://github.com/A-EVO-Lab/a-evolve/tree/release/harness-evolution.
Search
Fix author
Co-authors
- Juncheng Wu 4
- Cihang Xie 3
- Zijun Wang 2
- Hardy Chen 1
- Benoit Dumoulin 1
- Bing He 1
- Lianghua He 1
- Minhua Lin 1
- Fengze Liu 1
- Xiangyan Liu 1
- Yihang Liu 1
- Zewen Liu 1
- Hanqing Lu 1
- Luyang Luo 1
- Zhangkai Ni 1
- Tianyu Pang 1
- Pranav Rajpurkar 1
- Yisi Sang 1
- Zhan Shi 1
- Haoqin Tu 1
- Dakuo Wang 1
- Haojin Wang 1
- Jingshen Wang 1
- Kang Wang 1
- Suhang Wang 1
- Yahong Wang 1
- Tianxin Wei 1
- Ying Wen 1
- Zongyu Wu 1
- Qizhe Xie 1
- Carl Yang 1
- Chengmei Yang 1
- Longzhen Yang 1
- Yang Yang 1
- Huaxiu Yao 1
- Suhao Yu 1
- Yannan Yu 1
- Zhenlong Yuan 1
- Letian Zhang 1
- Xiang Zhang 1
- Zhiwei Zhang 1
- Zeyu Zheng 1