Yan-Lun Chen
Author directory2026
Tracing Target Answers in Poisoned Retrieval Corpora via Token Influence Attribution
Yan-Lun Chen | Pin-Yu Chen | Chia-Mu Yu | Ying-Dar Lin | Yu-Sung Wu | Wei-Bin Lee
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Yan-Lun Chen | Pin-Yu Chen | Chia-Mu Yu | Ying-Dar Lin | Yu-Sung Wu | Wei-Bin Lee
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Retrieval-Augmented Generation (RAG) systems are vulnerable to corpus poisoning attacks that manipulate model outputs through malicious retrieved documents. Existing detection methods typically rely on auxiliary classifiers or additional LLM-based verification, introducing substantial computational overhead. We present TRACE, a lightweight detection framework that identifies poisoning attacks by tracing answer-related tokens through token influence attribution. TRACE first discovers recurrent high-influence keywords across retrieved documents and then performs a secondary verification to confirm their influence on model predictions. Experiments on three QA benchmarks and six LLMs demonstrate strong detection performance while simultaneously uncovering attacker-specified target answers.
2025
Layer-Aware Task Arithmetic: Disentangling Task-Specific and Instruction-Following Knowledge
Yan-Lun Chen | Yi-Ru Wei | Chia-Yi Hsu | Chia-Mu Yu | Chun-Ying Huang | Ying-Dar Lin | Yu-Sung Wu | Wei-Bin Lee
Findings of the Association for Computational Linguistics: EMNLP 2025
Yan-Lun Chen | Yi-Ru Wei | Chia-Yi Hsu | Chia-Mu Yu | Chun-Ying Huang | Ying-Dar Lin | Yu-Sung Wu | Wei-Bin Lee
Findings of the Association for Computational Linguistics: EMNLP 2025
Large language models (LLMs) demonstrate strong task-specific capabilities through fine-tuning, but merging multiple fine-tuned models often leads to degraded performance due to overlapping instruction-following components. Task Arithmetic (TA), which combines task vectors derived from fine-tuning, enables multi-task learning and task forgetting but struggles to isolate task-specific knowledge from general instruction-following behavior. To address this, we propose Layer-Aware Task Arithmetic (LATA), a novel approach that assigns layer-specific weights to task vectors based on their alignment with instruction-following or task-specific components. By amplifying task-relevant layers and attenuating instruction-following layers, LATA improves task learning and forgetting performance while preserving overall model utility. Experiments on multiple benchmarks, including WikiText-2, GSM8K, and HumanEval, demonstrate that LATA outperforms existing methods in both multi-task learning and selective task forgetting, achieving higher task accuracy and alignment with minimal degradation in output quality. Our findings highlight the importance of layer-wise analysis in disentangling task-specific and general-purpose knowledge, offering a robust framework for efficient model merging and editing.