Zihan Wang
Author directoryOther people with similar names: Wang Zihan, Zihan Wang, Zihan Wang, Zihan Wang, Zihan Wang, Zihan Wang, Zihan Wang, Zihan Wang, Zihan Wang, Zihan Wang, Zihan Wang, Zihan Wang, Zihan Wang
Unverified author pages with similar names: Zihan Wang
2026
EMCompress: Video-LLMs with Endomorphic Multimodal Compression
Zheyu Fan | Jiateng Liu | Yuji Zhang | Zihan Wang | Yi R. Fung | Manling Li | Heng Ji
Findings of the Association for Computational Linguistics: ACL 2026
Zheyu Fan | Jiateng Liu | Yuji Zhang | Zihan Wang | Yi R. Fung | Manling Li | Heng Ji
Findings of the Association for Computational Linguistics: ACL 2026
Video-LLMs face a fundamental tension in long-video reasoning: static, sparse frame sampling either dilutes evidence across task-irrelevant segments at significant cost or misses fine-grained temporal semantics altogether. We propose a novel, cognitively-inspired task — Endomorphic Multimodal Compression (EMC) — as a structurally-constrained sufficient-statistic problem for VideoQA, and formulate it as an endomorphic transformation F_EMC : (V, Q) → (v, q) that compresses the multimodal input while preserving answer invariance across reasonable downstream models. The endomorphic form keeps the compressed output in the downstream pipeline’s native task space — a structural mirror of the filter-then-reason mechanism in the cognitive literature motivating EMC — distinguishing it from latent-code compression (IB / VIB) and making the formulation extensible to other multimodal settings. Under the Markov chain A → (V, Q) → (v, q), EMC realizes the classical sufficiency condition I((v, q); A) = I((V, Q); A) in its VideoQA-natural form. As a modular front-end, EMC plugs into both Video Instruction Tuning and Video Question Answering pipelines. We release the first dedicated benchmark and propose ReSimplifyIt, an EMC baseline surpassing prior methods by 0.40 F-1 with competitive query rewriting. Integrating EMC yields relative gains of 7.33% in training and 33.7% in inference for video-language understanding.
Failure Modes in Agentic AI: From Reproducible Triggers and Diagnostics to Reliable Fixes
Zoey Sha Li | Zihan Wang | Hejie Cui | Manling Li
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Tutorial Abstracts
Zoey Sha Li | Zihan Wang | Hejie Cui | Manling Li
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Tutorial Abstracts
Foundation-model agents are being deployed faster than the community can characterize how they fail. In barely two years they have moved into browsing, software engineering, computer use, scientific discovery, and embodied control, where reliability is governed by long-horizon, closed-loop interaction that current single-turn evaluation paradigms rarely capture. Failures (error cascades, reward hacking, mode and reasoning collapse, memory drift, and over-reasoning loops) still lack a shared vocabulary, reproducible triggers, and comparable diagnostics. This cutting-edge tutorial gives a systematic, mechanism-first account of agentic failure modes across four axes: (1) environments and infrastructure, (2) training dynamics, (3) evaluation and red teaming, and (4) test-time scaling and adaptation, with safety threaded throughout. Attendees leave with reproducible triggers, comparable diagnostic protocols, and verifiable mitigations.
2024
Let the Expert Stick to His Last: Expert-Specialized Fine-Tuning for Sparse Architectural Large Language Models
Zihan Wang | Deli Chen | Damai Dai | Runxin Xu | Zhuoshu Li | Yu Wu
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Zihan Wang | Deli Chen | Damai Dai | Runxin Xu | Zhuoshu Li | Yu Wu
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Parameter-efficient fine-tuning (PEFT) is crucial for customizing Large Language Models (LLMs) with constrained resource. Although there have been various PEFT methods for dense-architecture LLMs, PEFT for sparse-architecture LLMs is still underexplored. In this work, we study the PEFT method for LLMs with the Mixture-of-Experts (MoE) architecture and the contents of this work are mainly threefold: (1) We investigate the dispersion degree of the activated experts in customized tasks, and found that the routing distribution for specific task tend to be highly concentrated, while the distribution of activated experts varies significantly across different tasks. (2) We propose the expert-specialized fine-tuning method, which tunes the experts most relevant to downstream tasks while freezing the other experts; experimental results demonstrate that our method not only improves the tuning efficiency, but also matches or even surpasses the performance of full-parameter fine-tuning. (3) We further analyze the impact of the MoE architecture on expert-specialized fine-tuning. We find that MoE models with finer-grained experts are more advantageous in selecting the combination of experts that are most relevant to downstream tasks, thereby enhancing the both the training efficiency and effectiveness.