Yijin Zhou
Author directory2026
Exploring Agentic Tool-Calling Decisions via Uncertainty-Aligned Reinforcement Learning
Yijin Zhou | Linqian Zeng | Xiaoya Lu | Wenyuan Xie | Dongrui Liu | Junchi Yan | Jing Shao
Findings of the Association for Computational Linguistics: EMNLP 2026
Yijin Zhou | Linqian Zeng | Xiaoya Lu | Wenyuan Xie | Dongrui Liu | Junchi Yan | Jing Shao
Findings of the Association for Computational Linguistics: EMNLP 2026
Large language model (LLM)-based agents often make suboptimal tool-use decisions, including unsupported tool invocation and hallucinated direct responses, which may accumulate errors throughout multi-step interactions. Existing approaches mainly improve these behaviors through inference-time correction or coarse-grained reward signals based on decision outcomes and structured checklists, leaving the uncertainty characteristics of agent decisions underexplored. We observe that decision-oriented reinforcement learning tends to weaken the uncertainty separation between correct and incorrect actions, resulting in overconfident mistakes and weaker exploration signals. Therefore, we propose TRUST, which incorporates uncertainty quantification into reward design as a repulsive force for maintaining uncertainty separation, and labels lightweight key-turn annotations for unified post-training of multi-turn trajectories. Experimental results across diverse tool-use benchmarks show that TRUST consistently enhances both decision quality and agent performance while maintaining more reliable uncertainty estimates during optimization.
INFA-Guard: Mitigating Malicious Propagation via Infection-Aware Safeguarding in LLM-Based Multi-Agent Systems
Yijin Zhou | Xiaoya Lu | Dongrui Liu | Junchi Yan | Jing Shao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yijin Zhou | Xiaoya Lu | Dongrui Liu | Junchi Yan | Jing Shao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
The rapid advancement of Large Language Model (LLM)-based Multi-Agent Systems (MAS) has introduced significant security vulnerabilities, where malicious influence can propagate virally through inter-agent communication. Conventional safeguards often rely on a binary paradigm that strictly distinguishes between benign and attack agents, failing to account for infected agents, i.e., benign entities converted by attack agents. In this paper, we propose Infection-Aware Guard, INFA-Guard, a novel defense framework that explicitly identifies and addresses infected agents as a distinct threat category. By leveraging infection-aware detection and topological constraints, INFA-Guard accurately localizes attack sources and infected ranges. During remediation, INFA-Guard replaces attackers and rehabilitates infected ones, avoiding malicious propagation while preserving topological integrity. Extensive experiments demonstrate that INFA-Guard achieves state-of-the-art performance, reducing the Attack Success Rate (ASR) by an average of 33%, while exhibiting cross-model robustness, superior topological generalization, and high cost-effectiveness. Code is released under https://github.com/yjzscode/INFA-Guard.