Zeyu Zhang
Author directoryOther people with similar names: Zeyu Zhang, Zeyu Zhang, Zeyu Zhang, Zeyu Zhang, Zeyu Zhang
Unverified author pages with similar names: Zeyu Zhang
2026
How Order-Sensitive Are LLMs? OrderProbe for Deterministic Structural Reconstruction
Zhaolu Kang | Yingjie He | Kehan Jiang | Leqi Zheng | Jiachen Qian | Qianyuan Zhang | Chunlei Meng | Yujie Feng | Yuan Wang | Stephen Dou | Aming Wu | Pengxiang Zhao | Jiaxin Liu | Guansu Wang | Zeyu Zhang | Zeyu Wang | Lei Wang | Qishi Zhan | Xiaomin He | Meisheng Zhang | Jianyuan Ni | Richeng Xuan
Findings of the Association for Computational Linguistics: EMNLP 2026
Zhaolu Kang | Yingjie He | Kehan Jiang | Leqi Zheng | Jiachen Qian | Qianyuan Zhang | Chunlei Meng | Yujie Feng | Yuan Wang | Stephen Dou | Aming Wu | Pengxiang Zhao | Jiaxin Liu | Guansu Wang | Zeyu Zhang | Zeyu Wang | Lei Wang | Qishi Zhan | Xiaomin He | Meisheng Zhang | Jianyuan Ni | Richeng Xuan
Findings of the Association for Computational Linguistics: EMNLP 2026
Large language models (LLMs) excel at semantic understanding, yet their ability to reconstruct internal structure from scrambled inputs remains underexplored. Sentence-level restoration is difficult to evaluate automatically because scrambled sentences often admit multiple valid reorderings. We introduce OrderProbe, a deterministic benchmark for structural reconstruction using fixed four-character expressions in Chinese, Japanese, and Korean, which have a unique canonical order and thus support exact-match scoring. We further propose a diagnostic framework that evaluates models beyond recovery accuracy, including Semantic Accuracy, Logical Validity, Structural Consistency, Robustness, and Information Density. Experiments on twelve widely used LLMs show that structural reconstruction remains difficult even for frontier systems: zero-shot recovery frequently falls below 35%. We also observe a consistent gap between meaning-oriented generation and exact structural reconstruction, suggesting that structural robustness is not an automatic byproduct of semantic competence.
SafeMo: Linguistically Grounded Unlearning for Trustworthy Text-to-Motion Generation
Yiling Wang | Zeyu Zhang | Yiran Wang | Hao Tang
Findings of the Association for Computational Linguistics: EMNLP 2026
Yiling Wang | Zeyu Zhang | Yiran Wang | Hao Tang
Findings of the Association for Computational Linguistics: EMNLP 2026
Text-to-motion (T2M) generation has achieved impressive realism but poses significant safety risks by faithfully executing unsafe textual prompts. Existing motion unlearning methods face dual challenges: brittle keyword filtering and discrete codebook manipulation, which may degrade benign generation quality and introduce jerky transitions. To address these challenges, we propose SafeMo, a linguistically grounded framework that leverages Large Language Models (LLMs) to align motion generation with safety constraints. First, we introduce SafeMoEngine, an LLM-agent pipeline that autonomously classifies unsafe intents and performs semantic rewriting to construct SafeMoVAE-29K, the first safety-aligned text-to-motion dataset. Second, we propose Minimal Motion Unlearning (MMU), a continuous-space unlearning strategy that projects unsafe semantic concepts into a task vector for precise negation, avoiding the quantization artifacts of discrete methods. Experiments demonstrate SafeMo’s effective unlearning performance by more strongly suppressing unsafe text–motion retrieval than the prior SOTA motion unlearning baseline LCR, reducing forget-set R@1 by 35.3% and achieving 2.61× normalized retrieval trade-off score (NRTS), while showing better or competitive benign utility on safe prompts, with similar trends on Motion-X. Code and checkpoints are publicly available at https://github.com/AIGeeksGroup/SafeMo. Project page: https://aigeeksgroup.github.io/SafeMo.
VaseVQA: Multimodal Agent and Benchmark for Ancient Greek Pottery
Jinchao Ge | Tengfei Cheng | Biao Wu | Zeyu Zhang | Shiya Huang | Judith Bishop | Gillian Shepherd | Meng Fang | Ling Chen | Yang Zhao
Findings of the Association for Computational Linguistics: EACL 2026
Jinchao Ge | Tengfei Cheng | Biao Wu | Zeyu Zhang | Shiya Huang | Judith Bishop | Gillian Shepherd | Meng Fang | Ling Chen | Yang Zhao
Findings of the Association for Computational Linguistics: EACL 2026
Understanding cultural heritage artifacts such as ancient Greek pottery requires expert-level reasoning that remains challenging for current MLLMs due to limited domain-specific data. We introduce VaseVQA, a benchmark for ancient Greek pottery, primarily vases, consisting of 31,773 images and 67,614 question–answer pairs across seven expert-defined categories, enabling systematic evaluation of expert-level cultural heritage understanding. Using this dataset, we explore effective training strategies for domain-specific reasoning. While supervised fine-tuning improves adaptation to domain knowledge, it struggles with deeper reasoning tasks. We propose VaseVL, which augments SFT with reinforcement learning using verifiable rewards. Experiments show that VaseVL consistently outperforms supervised baselines, especially on reasoning-intensive questions, highlighting the value of targeted reinforcement learning for cultural heritage visual question answering.
CoV: Chain-of-View Prompting for Spatial Reasoning
Haoyu Zhao | Akide Liu | Zeyu Zhang | Weijie Wang | Feng Chen | Ruihan Zhu | Gholamreza Haffari | Bohan Zhuang
Findings of the Association for Computational Linguistics: ACL 2026
Haoyu Zhao | Akide Liu | Zeyu Zhang | Weijie Wang | Feng Chen | Ruihan Zhu | Gholamreza Haffari | Bohan Zhuang
Findings of the Association for Computational Linguistics: ACL 2026
Embodied question answering (EQA) in 3D environments often requires collecting context that is distributed across multiple viewpoints and partially occluded. However, most recent vision–language models (VLMs) are constrained to a fixed and finite set of input views, which limits their ability to acquire question-relevant context at inference time and hinders complex spatial reasoning. We propose Chain-of-View (CoV) prompting, a training-free, test-time reasoning framework that transforms a VLM into an active viewpoint reasoner through a coarse-to-fine exploration process. CoV first employs a View Selection agent to filter redundant frames and identify question-aligned anchor views. It then performs fine-grained view adjustment by interleaving iterative reasoning with discrete camera actions, obtaining new observations from the underlying 3D scene representation until sufficient context is gathered or a step budget is reached. We evaluate CoV on OpenEQA across four mainstream VLMs and obtain an average 11.98% improvement in LLM-Match, with a maximum gain of 13.62% on Qwen3-VL-Flash. CoV further exhibits test-time scaling: increasing the minimum action budget yields an additional 2.54% average improvement, peaking at 3.73% on Gemini-2.5-Flash. On ScanQA and SQA3D, CoV delivers strong performance (e.g., 116 CIDEr 31.9 EM@1 on ScanQA and 51.1 EM@1 on SQA3D). Overall, these results suggest that question-aligned view selection coupled with open-view search is an effective, model-agnostic strategy for improving spatial reasoning in 3D EQA without additional training.
V-Retrver: Evidence-Driven Agentic Reasoning for Universal Multimodal Retrieval
Dongyang Chen | Chaoyang Wang | Dezhao Su | Xi Xiao | Zeyu Zhang | Jing Xiong | Qing Li | Yuzhang Shang | Shichao Kan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Dongyang Chen | Chaoyang Wang | Dezhao Su | Xi Xiao | Zeyu Zhang | Jing Xiong | Qing Li | Yuzhang Shang | Shichao Kan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Multimodal Large Language Models (MLLMs) have recently been applied to universal multimodal retrieval, where Chain-of-Thought (CoT) reasoning improves candidate reranking. However, existing approaches remain largely language-driven, relying on static visual encodings and lacking the ability to actively verify fine-grained visual evidence, which often leads to speculative reasoning in visually ambiguous cases. We propose V-Retrver, an evidence-driven retrieval framework that reformulates multimodal retrieval as an agentic reasoning process grounded in visual inspection. V-Retrver enables an MLLM to selectively acquire visual evidence during reasoning via external visual tools, performing a multimodal interleaved reasoning process that alternates between hypothesis generation and targeted visual verification. To train such an evidence-gathering retrieval agent, we adopt a curriculum-based learning strategy combining supervised reasoning activation, rejection-based refinement, and reinforcement learning with an evidence-aligned objective. Experiments across multiple multimodal retrieval benchmarks demonstrate consistent improvements in retrieval accuracy (with 23.0% improvements on average), perception-driven reasoning reliability, and generalization.
Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Models
Zirui Song | Qian Jiang | Mingxuan Cui | Mingzhe Li | Lang Gao | Zeyu Zhang | Zixiang Xu | Yanbo Wang | Guangxian Ouyang | Zhenhao Chen | Xiuying Chen
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zirui Song | Qian Jiang | Mingxuan Cui | Mingzhe Li | Lang Gao | Zeyu Zhang | Zixiang Xu | Yanbo Wang | Guangxian Ouyang | Zhenhao Chen | Xiuying Chen
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
The rise of Large Audio-Language Models (LAMs) brings both potential and risks, as their audio outputs may contain harmful or unethical content. However, current research lacks a systematic, quantitative evaluation of LAM safety, especially against jailbreak attacks, which are challenging due to the temporal and semantic nature of speech. To bridge this gap, we introduce AJailBench, the first benchmark specifically designed to evaluate jailbreak vulnerabilities in LAMs. We begin by constructing -Base, a dataset of 1,495 adversarial audio prompts spanning 10 policy-violating categories. Using this dataset, we evaluate several state-of-the-art LAMs and reveal that none exhibit consistent robustness across attacks. To further strengthen jailbreak testing and simulate more realistic attack conditions, we propose a method to generate dynamic adversarial variants. Our Audio Perturbation Toolkit (APT) applies targeted distortions across time, frequency, and amplitude domains. To preserve the original jailbreak intent, we enforce a semantic consistency constraint and employ Bayesian optimization to efficiently search for perturbations that are both subtle and highly effective. This results in AJailBench-APT+, an extended dataset of optimized adversarial audio samples. Our findings demonstrate that even small, semantically preserved perturbations can significantly reduce the safety performance of leading LAMs, underscoring the need for more robust and semantically aware defense mechanisms. We release AJailBench to facilitate future research: https://anonymous.4open.science/r/AudioJailbreak-4262/
MMCLIP: Cross-Modal Attention Masked Modelling for Medical Language-Image Pre-Training
Biao Wu | Yutong Xie | Zeyu Zhang | Vu Minh Hieu Phan | Qi Chen | Ling Chen | Qi Wu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Biao Wu | Yutong Xie | Zeyu Zhang | Vu Minh Hieu Phan | Qi Chen | Ling Chen | Qi Wu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Vision-and-language pretraining (VLP) in medicine leverages contrastive learning on image–text pairs, often enhanced with masked modeling. However, existing methods face two challenges: difficulty reconstructing key pathological features due to limited data, and reliance on either paired or image-only datasets without combining both. To address this, we propose MMCLIP (Masked Medical Contrastive Language–Image Pre-training), which introduces two modules: AttMIM: Masks image features highly correlated with text to improve reconstruction of fine medical details. EntMLM: Masks key medical entities in text and reconstructs them using visual cues. Furthermore, MMCLIP incorporates unpaired data through disease-kind prompts, achieving state-of-the-art performance in zero-shot and fine-tuning across five benchmarks.
2025
Hazards in Daily Life? Enabling Robots to Proactively Detect and Resolve Anomalies
Zirui Song | Guangxian Ouyang | Meng Fang | Hongbin Na | Zijing Shi | Zhenhao Chen | Fu Yujie | Zeyu Zhang | Shiyu Jiang | Miao Fang | Ling Chen | Xiuying Chen
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Zirui Song | Guangxian Ouyang | Meng Fang | Hongbin Na | Zijing Shi | Zhenhao Chen | Fu Yujie | Zeyu Zhang | Shiyu Jiang | Miao Fang | Ling Chen | Xiuying Chen
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Existing household robots have made significant progress in performing routine tasks, such as cleaning floors or delivering objects. However, a key limitation of these robots is their inability to recognize potential problems or dangers in home environments. For example, a child may pick up and ingest medication that has fallen on the floor, posing a serious risk. We argue that household robots should proactively detect such hazards or anomalies within the home, and propose the task of anomaly scenario generation. To accomplish this task, we leverage foundational models instead of relying on manually labeled data to build simulated environments. Specifically, we introduce a multi-agent brainstorming approach, where agents collaborate and generate diverse scenarios covering household hazards, hygiene management, and child safety. These textual task descriptions are then integrated with designed 3D assets to simulate realistic environments. Within these constructed environments, our LLM-based robotic agent learns the necessary skills to proactively discover and handle the proposed anomalies through task decomposition, optimal learning approach selection. We demonstrate that our generated environment outperforms others in terms of task description and scene diversity, ultimately enabling robotic agents to better address potential household hazards.
PresentAgent: Multimodal Agent for Presentation Video Generation
Jingwei Shi | Zeyu Zhang | Biao Wu | Yanjie Liang | Meng Fang | Ling Chen | Yang Zhao
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Jingwei Shi | Zeyu Zhang | Biao Wu | Yanjie Liang | Meng Fang | Ling Chen | Yang Zhao
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
We present PresentAgent, a multimodal agent that transforms long-form documents into narrated presentation videos. While existing approaches are limited to generating static slides or text summaries, our method advances beyond these limitations by producing fully synchronized visual and spoken content that closely mimics human-style presentations. To achieve this integration, PresentAgent employs a modular pipeline that systematically segments the input document, plans and renders slide-style visual frames, generates contextual spoken narration with large language models and Text-to-Speech models, and seamlessly composes the final video with precise audio-visual alignment. Given the complexity of evaluating such multimodal outputs, we introduce PresentEval, a unified assessment framework powered by Vision-Language Models that comprehensively scores videos across three critical dimensions: content fidelity, visual clarity, and audience comprehension through prompt-based evaluation. Our experimental validation on a curated dataset of 30 document–presentation pairs demonstrates that PresentAgent approaches human-level quality across all evaluation metrics. These results highlight the significant potential of controllable multimodal agents in transforming static textual materials into dynamic, effective, and accessible presentation formats.
Search
Fix author
Co-authors
- Ling Chen 4
- Meng Fang 3
- Biao Wu 3
- Xiuying Chen 2
- Zhenhao Chen 2
- Guangxian Ouyang 2
- Zirui Song 2
- Yang Zhao 2
- Judith Bishop 1
- Dongyang Chen 1
- Feng Chen 1
- Qi Chen 1
- Tengfei Cheng 1
- Mingxuan Cui 1
- Stephen Dou 1
- Miao Fang 1
- Yujie Feng 1
- Lang Gao 1
- Jinchao Ge 1
- Gholamreza Haffari 1
- Xiaomin He 1
- Yingjie He 1
- Shiya Huang 1
- Kehan Jiang 1
- Qian Jiang 1
- Shiyu Jiang 1
- Shichao Kan 1
- Zhaolu Kang 1
- Mingzhe Li 1
- Qing Li 1
- Yanjie Liang 1
- Akide Liu 1
- Jiaxin Liu 1
- Chunlei Meng 1
- Hongbin Na 1
- Jianyuan Ni 1
- Minh Hieu Phan 1
- Jiachen Qian 1
- Yuzhang Shang 1
- Gillian Shepherd 1
- Jingwei Shi 1
- Zijing Shi 1
- Dezhao Su 1
- Hao Tang 1
- Chaoyang Wang 1
- Guansu Wang 1
- Lei Wang 1
- Weijie Wang 1
- Yanbo Wang 1
- Yiling Wang 1
- Yiran Wang 1
- Yuan Wang 1
- Zeyu Wang 1
- Aming Wu 1
- Qi Wu 1
- Xi Xiao 1
- Yutong Xie 1
- Jing Xiong 1
- Zixiang Xu 1
- Richeng Xuan 1
- Fu Yujie 1
- Qishi Zhan 1
- Meisheng Zhang 1
- Qianyuan Zhang 1
- Haoyu Zhao 1
- Pengxiang Zhao 1
- Leqi Zheng 1
- Ruihan Zhu 1
- Bohan Zhuang 1