Chenyou Fan
Author directory2026
Sampling Less, Knowing More: Contradiction-aware Adaptive Spectral and Entropic Uncertainty Quantification for LLMs
Jiaming Zhang | Heng-yang Lu | Xinan Chen | Junyuan Zheng | Yuncheng Jiang | Ying Zhu | Chenyou Fan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Jiaming Zhang | Heng-yang Lu | Xinan Chen | Junyuan Zheng | Yuncheng Jiang | Ying Zhu | Chenyou Fan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Uncertainty quantification (UQ) is essential for improving the reliability of large language models (LLMs). However, multi-sample UQ methods typically employ a fixed sampling budget for all queries, leading to computational redundancy. In addition, multi-sample UQ methods often fail in the presence of consistent errors. To address these limitations, we propose CASE (Contradiction-aware Adaptive Spectral and Entropic UQ), a UQ framework that jointly models semantic disagreement and token-level uncertainty under an adaptive sampling paradigm. Specifically, CASE constructs a contradiction graph over sampled responses and quantifies semantic disagreement using normalized spectral norms of the graph representation. The resulting uncertainty signals are further leveraged for adaptive sampling, enabling query-dependent budget allocation while reducing redundant computation. In addition, CASE incorporates token-level predictive entropy as a complementary uncertainty signal to mitigate the failure of graph structures under consistent errors. Experimental results demonstrate that CASE outperforms existing multi-sample UQ methods across factual question answering datasets while reducing sampling costs by over 30% on average.
2022
Where to Attack: A Dynamic Locator Model for Backdoor Attack in Text Classifications
Heng-yang Lu | Chenyou Fan | Jun Yang | Cong Hu | Wei Fang | Xiao-jun Wu
Proceedings of the 29th International Conference on Computational Linguistics
Heng-yang Lu | Chenyou Fan | Jun Yang | Cong Hu | Wei Fang | Xiao-jun Wu
Proceedings of the 29th International Conference on Computational Linguistics
Nowadays, deep-learning based NLP models are usually trained with large-scale third-party data which can be easily injected with malicious backdoors. Thus, BackDoor Attack (BDA) study has become a trending research to help promote the robustness of an NLP system. Text-based BDA aims to train a poisoned model with both clean and poisoned texts to perform normally on clean inputs while being misled to predict those trigger-embedded texts as target labels set by attackers. Previous works usually choose fixed Positions-to-Poison (P2P) first, then add triggers upon those positions such as letter insertion or deletion. However, considering the positions of words with important semantics may vary in different contexts, fixed P2P models are severely limited in flexibility and performance. We study the text-based BDA from the perspective of automatically and dynamically selecting P2P from contexts. We design a novel Locator model which can predict P2P dynamically without human intervention. Based on the predicted P2P, four effective strategies are introduced to show the BDA performance. Experiments on two public datasets show both tinier test accuracy gap on clean data and higher attack success rate on poisoned ones. Human evaluation with volunteers also shows the P2P predicted by our model are important for classification. Source code is available at https://github.com/jncsnlp/LocatorModel