Huan Chen
Author directoryOther people with similar names: Huan Chen
Unverified author pages with similar names: Huan Chen
2026
Explication of Refusal: Jailbreaking LLMs by Exploiting Refusal Explanations
Qishen Xu | Ruochun Jin | Ting Wang | Zhongxuan Cai | Ruxin Chen | Huan Chen
Findings of the Association for Computational Linguistics: EMNLP 2026
Qishen Xu | Ruochun Jin | Ting Wang | Zhongxuan Cai | Ruxin Chen | Huan Chen
Findings of the Association for Computational Linguistics: EMNLP 2026
Safety-aligned large language models (LLMs) face a dilemma between helpfulness and harmlessness, where LLMs are expected to refuse harmful requests while remaining helpful by explaining their decisions. In this work, we observe a phenomenon caused by this dilemma. When asked to explain a refusal triggered by a harmful query, LLMs disclose exploitable elements in their refusal explanations. These elements allow attackers to induce the generation of harmful content. We formalize this vulnerability as Induced Refusal Explication (IRE). To identify and exploit IRE, we propose Explication of Refusal (EoR), a black-box and multi-turn jailbreak method with a dual-agent framework. EoR induces and analyzes refusal explanations from victim models and then generates follow-up queries to jailbreak them. We evaluate EoR across nine victim models. EoR achieves an average attack success rate (ASR) of **37.05** within five turns. When we apply EoR to the queries that PAIR fails to jailbreak, EoR reaches an average ASR of **66.0** across the nine victim models, which demonstrates that exploiting refusal explanations is complementary to existing automated jailbreak methods. We release our data and code at https://anonymous.4open.science/r/EoR-6234.
2024
Context-Driven Index Trimming: A Data Quality Perspective to Enhancing Precision of RALMs
Kexin Ma | Ruochun Jin | Wang Haotian | Wang Xi | Huan Chen | Yuhua Tang | Qian Wang
Findings of the Association for Computational Linguistics: EMNLP 2024
Kexin Ma | Ruochun Jin | Wang Haotian | Wang Xi | Huan Chen | Yuhua Tang | Qian Wang
Findings of the Association for Computational Linguistics: EMNLP 2024
Retrieval-Augmented Large Language Models(RALMs) have made significant strides in enhancing the accuracy of generated responses. However, existing research often overlooks the data quality issues within retrieval results, often caused by inaccurate existing vector-distance-based retrieval methods. We propose to boost the precision of RALMs’ answers from a data quality perspective through the Context-Driven Index Trimming (CDIT) framework, where Context Matching Dependencies (CMDs) are employed as logical data quality rules to capture and regulate the consistency between retrieved contexts. Based on the semantic comprehension capabilities of Large Language Models (LLMs), CDIT can effectively identify and discard retrieval results that are inconsistent with the query context and further modify indexes in the database, thereby improving answer quality. Experiments demonstrate average improvement of 3.75% in accuracy on challenging open-domain question-answering tasks. Also, the flexibility of CDIT is verified through its compatibility with various language models and indexing methods, which offers a promising approach to bolster RALMs’ data quality and retrieval precision jointly.