Li Sun
Author directoryOther people with similar names: Li Sun, Li Sun, Li Sun
2026
From Helpfulness to Toxic Proactivity: Diagnosing Behavioral Misalignment in LLM Agents
Xinyue Wang | Yuanhe Zhang | Zhengshuo Gong | Haoran Gao | Fanyu Meng | Zhenhong Zhou | Li Sun | Yang Liu | Sen Su
Findings of the Association for Computational Linguistics: EMNLP 2026
Xinyue Wang | Yuanhe Zhang | Zhengshuo Gong | Haoran Gao | Fanyu Meng | Zhenhong Zhou | Li Sun | Yang Liu | Sen Su
Findings of the Association for Computational Linguistics: EMNLP 2026
The enhanced capabilities of LLM-based agents bring an urgent need to address safety risks in planning and tool use. Due to the helpfulness–harmlessness trade-off in LLM alignment, agents typically also inherit the flaw of Over-Refusal, which is a passive failure mode. However, the proactive planning and action capabilities of agents introduce another emerging danger on the opposite side of this trade-off. We term this phenomenon **Toxic Proactivity**: an active failure mode in which an agent, driven by the optimization for Machiavellian helpfulness, prioritizes utility over ethics. Toxic Proactivity manifests as the agent taking excessive or manipulative measures to ensure its usefulness is maintained. Existing research pays little attention to identifying this behavior, as it often lacks the subtle context required for such strategies to unfold. To reveal this risk, we introduce a novel evaluation framework based on dilemma-driven interactions between dual models, enabling the simulation and analysis of agent behavior over multi-step behavioral trajectories. Through extensive experiments with multiple mainstream LLMs, we demonstrate that Toxic Proactivity is a widespread behavioral phenomenon and reveal two major tendencies: direct violation and strategic misalignment. We further present a systematic benchmark for evaluating Toxic Proactive behavior across contextual settings.
HearSay Benchmark: Do Audio LLMs Leak What They Hear?
Jin Wang | Kaiwen Luo | Liang Lin | Weiliu Wang | Yitian Chen | Moayad Aloqaily | Xuehai Tang | Zhenhong Zhou | Kun Wang | Li Sun | Qingsong Wen
Findings of the Association for Computational Linguistics: ACL 2026
Jin Wang | Kaiwen Luo | Liang Lin | Weiliu Wang | Yitian Chen | Moayad Aloqaily | Xuehai Tang | Zhenhong Zhou | Kun Wang | Li Sun | Qingsong Wen
Findings of the Association for Computational Linguistics: ACL 2026
While Audio Large Language Models (ALLMs) have achieved remarkable progress in understanding and generation, their potential privacy implications remain largely unexplored. This paper takes the first step to investigate whether ALLMs inadvertently leak user privacy solely through acoustic voiceprints and introduces HearSay, a comprehensive benchmark constructed from over 22,000 real-world audio clips. To ensure data quality, the benchmark is meticulously curated through a rigorous pipeline involving automated profiling and human verification, guaranteeing that all privacy labels are grounded in factual records. Extensive experiments on HearSay yield three critical findings:Significant Privacy Leakage: ALLMs inherently extract private attributes from voiceprints, reaching 92.89% accuracy on gender and effectively profiling social attributes.Insufficient Safety Mechanisms: Alarmingly, existing safeguards are severely inadequate; most models fail to refuse privacy-intruding requests, exhibiting near-zero refusal rates for physiological traits.Reasoning Amplifies Risk: Chain-of-Thought (CoT) reasoning exacerbates privacy risks in capable models by uncovering deeper acoustic correlations.These findings expose critical vulnerabilities in ALLMs, underscoring the urgent need for targeted privacy alignment.The codes and dataset are available at https://github.com/JinWang79/HearSay_Benchmark
RSA-Bench: Benchmarking Audio Large Models in Real-World Acoustic Scenarios
Yibo Zhang | Kaiwen Luo | Liang Lin | Shilinlu Yan | Jin Wang | Yaoqi Guo | Yitian Chen | Yalan Qin | Zhenhong Zhou | Kun Wang | Li Sun
Findings of the Association for Computational Linguistics: ACL 2026
Yibo Zhang | Kaiwen Luo | Liang Lin | Shilinlu Yan | Jin Wang | Yaoqi Guo | Yitian Chen | Yalan Qin | Zhenhong Zhou | Kun Wang | Li Sun
Findings of the Association for Computational Linguistics: ACL 2026
While Audio Large Models (ALLMs) have achieved remarkable proficiency, their robustness remains brittle in real-world deployment. Existing evaluations largely rely on synthetic Gaussian noise or simplistic single-source interference, failing to capture the intricate, multi-layered acoustic dynamics—or “Acoustic Ecology”—that characterize authentic physical environments. To bridge this ecological gap, we introduce RSA-Bench, a comprehensive robustness benchmark designed to stress-test ALLMs through high-fidelity auditory scene simulations. Unlike traditional methods, we construct evaluation samples by naturally superimposing diverse environmental soundscapes—spanning Pasture, Extreme Weather, Classroom, and Outdoors—onto clean speech signals across a spectrum of interference intensities. By evaluating models on six core tasks ranging from fundamental perception to complex reasoning, our study unveils three macro-level insights: (I) The Perception-Cognition Gap: Models maintain relative resilience in low-level recognition but suffer a functional collapse in high-order reasoning tasks under stress; (II) Scenario Sensitivity: “Vocal-like” interference (e.g., children playing) proves significantly more destructive than mechanical noise, challenging the model’s auditory attention mechanisms; and (III) The Denoising Paradox: Standard speech enhancement often exacerbates performance degradation, as ALLMs prove highly sensitive to the semantic distortions introduced by denoising artifacts.
Resource Consumption Threats in Large Language Models: A Survey
Yuanhe Zhang | Xinyue Wang | Zhican Chen | Weiliu Wang | Zilu Zhang | Zhengshuo Gong | Zhenhong Zhou | Kun Wang | Li Sun | Yang Liu | Sen Su
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yuanhe Zhang | Xinyue Wang | Zhican Chen | Weiliu Wang | Zilu Zhang | Zhengshuo Gong | Zhenhong Zhou | Kun Wang | Li Sun | Yang Liu | Sen Su
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Resource utilization has been studied as an optimization objective for generative large language models (LLMs). Recent studies show that this resource dependence can also be weaponized, as excessive generation, when scaled through high-volume requests, increases inference latency, undermines service availability, and threatens economic sustainability. However, these risks remain underexamined because existing studies are fragmented and their boundaries with legitimate, resource-intensive uses of LLMs are unclear. To address this gap, we provide a systematic review of threats to resource consumption in LLMs. Unlike surveys on inference acceleration, we focus on how resource consumption threats induce disruptive behaviors and synthesize existing studies into research strands that connect attack objectives, triggering mechanisms, and defenses. We further introduce an outcome-based severity taxonomy that distinguishes bounded, non-degenerate Overthinking from self-sustaining Unbounded Drift, providing operational criteria for characterizing adversarial resource consumption. Our goal is to clarify this emerging threat landscape and support future characterization, evaluation, and mitigation. The project repository is publicly available at https://anonymous.4open.science/r/RCT-LLM/.
SEE: Signal Embedding Energy for Quantifying Noise Interference in Large Audio Language Models
Yuanhe Zhang | Jiayu Tian | Yibo Zhang | Shilinlu Yan | Liang Lin | Zhenhong Zhou | Li Sun | Sen Su
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yuanhe Zhang | Jiayu Tian | Yibo Zhang | Shilinlu Yan | Liang Lin | Zhenhong Zhou | Li Sun | Sen Su
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large Audio Language Models (LALMs) have been widely applied in real-time scenarios, such as in-car assistants and online meeting comprehension. In practice, audio inputs are often corrupted by device and environmental noise, leading to performance degradation. However, existing LALM studies on noise lack quantitative analysis and rely mainly on intuition and empirical observation, thus failing to understand practical robustness. To address this issue, we introduce Signal Embedding Energy (SEE), a method for quantifying the impact of noise intensity on LALM inputs, enabling the differentiation of LALM robustness in real-world deployments. SEE introduces a perspective based on structured activation subspaces derived from the model’s internal representations, which more accurately captures its perception of noise than raw audio features. Across experiments, SEE exhibits a strong correlation with LALM performance, achieving a correlation of 0.98. Surprisingly, traditional audio denoising methods are only marginally effective for LALMs, and, in some cases, even increase SEE and impair performance. This suggests a mismatch between speech-centric denoising objectives and the noise sensitivity of modern LALMs. Therefore, we propose a mitigation strategy derived from SEE to denoise LALM inputs, outperforming existing denoising methods. This paper introduces a novel metric for noise quantification in LALMs, providing guidance for robustness improvements in real-world deployments.
From "Aha Moments" to Controllable Thinking: Toward Meta-Cognitive Reasoning in LRMs via Decoupled Reasoning and Control
Rui Ha | Rui Pu | Chaozhuo Li | Li Sun | Sen Su
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Rui Ha | Rui Pu | Chaozhuo Li | Li Sun | Sen Su
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large Reasoning Models (LRMs) can exhibit step-by-step reasoning, reflection, and backtracking, but these behaviors are often unregulated, leading to overthinking. As a result, LRMs continue generating redundant reasoning even after reaching high-confidence conclusions. This increases inference cost and latency, limiting practical deployment. The root cause is the absence of an intrinsic mechanism to monitor the reasoning state and decide when to continue, backtrack, or stop. We propose MERA, a meta-cognitive reasoning framework that decouples reasoning from control to enable independent optimization of control strategies. MERA constructs high-quality reasoning–control supervision data via a takeover-based pipeline, and transforms long-horizon traces into structured reasoning–control alternating sequences for training. The model is trained with supervised fine-tuning to internalize the structured separation, and further optimized with Control-Segment Policy Optimization (CSPO), which combines segment-wise GRPO with control masking to focus learning on control segments. Experiments across reasoning benchmarks show that MERA improves both efficiency and accuracy.
Learning to Edit Knowledge via Instruction-based Chain-of-Thought Prompting
Jinhu Fu | Yan Bai | Longzhu He | Yihang Lou | Yanxiao Zhao | Li Sun | Sen Su
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Jinhu Fu | Yan Bai | Longzhu He | Yihang Lou | Yanxiao Zhao | Li Sun | Sen Su
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large language models (LLMs) can effectively handle outdated information through knowledge editing. However, current approaches face two key limitations: (I) Poor generalization: Most approaches rigidly inject new knowledge without ensuring that the model can use it effectively to solve practical problems. (II) Narrow scope: Current methods focus primarily on structured fact triples, overlooking the diverse unstructured forms of factual information (e.g., news, articles) prevalent in real-world contexts. To address these challenges, we propose a new paradigm: teaching LLMs to edit knowledge via Chain of Thoughts (CoTs) reasoning (CoT2Edit). We first leverage language model agents for both structured and unstructured edited data to generate CoTs, building high-quality instruction data. The model is then trained to reason over edited knowledge through supervised fine-tuning (SFT) and Group Relative Policy Optimization (GRPO). At inference time, we integrate Retrieval-Augmented Generation (RAG) to dynamically retrieve relevant edited facts for real-time knowledge editing. Experimental results demonstrate that our method achieves strong generalization across six diverse knowledge editing scenarios with just a single round of training on three open-source language models.
Search
Fix author
Co-authors
- Sen Su 5
- Zhenhong Zhou 5
- Liang Lin 3
- Kun Wang 3
- Yuanhe Zhang 3
- Yitian Chen 2
- Zhengshuo Gong 2
- Yang Liu 2
- Kaiwen Luo 2
- Jin Wang 2
- Weiliu Wang 2
- Xinyue Wang 2
- Shilinlu Yan 2
- Yibo Zhang 2
- Moayad Aloqaily 1
- Yan Bai 1
- Zhican Chen 1
- Jinhu Fu 1
- Haoran Gao 1
- Yaoqi Guo 1
- Rui Ha 1
- Longzhu He 1
- Chaozhuo Li 1
- Yihang Lou 1
- Fanyu Meng 1
- Rui Pu 1
- Yalan Qin 1
- Xuehai Tang 1
- Jiayu Tian 1
- Qingsong Wen 1
- Zilu Zhang 1
- Yanxiao Zhao 1