Deng Pan
Author directory2026
Does Thinking Help Fairness? Reasoning Tokens Resolve Some Biases but Create More
Deng Pan | Joe Germino | Yihong Ma | Elizabeth M. Daly | Nuno Moniz | Ting Hua | Nitesh V. Chawla
Findings of the Association for Computational Linguistics: EMNLP 2026
Deng Pan | Joe Germino | Yihong Ma | Elizabeth M. Daly | Nuno Moniz | Ting Hua | Nitesh V. Chawla
Findings of the Association for Computational Linguistics: EMNLP 2026
Thinking in reasoning language models (RLMs) has been subject to debate on whether it resolves or amplifies bias. Prior works have shown competing conclusions in both directions. Using a within-model thinking-vs.-non-thinking ablation across QwQ-32B, DeepSeek-R1-Distill-Qwen-32B, and Qwen3-32B on three high-stakes decision tasks (Adult, COMPAS, Credit), we show that thinking has an asymmetric dual effect on counterfactual fairness: it both resolves counterfactual flips produced by the non-thinking baseline and creates new flips at near-saturating model confidence. In all nine (model, dataset) combinations, the created flips outnumber the resolved flips by roughly 5×. To explain the effect, we treat the thinking trace itself as a measurable site of fairness change and study it through two dynamic instruments: 1) We propose Counterfactual Depth Probability Gap (CDPG) to track bias evolution along thinking depth, and observe that bias propagates and amplifies with thinking. 2) We also formulate Bias Transition Matrices (BTM) to show how predictions of counterfactual pairs change from non-thinking to thinking, and find that the asymmetric dual effect originates in the pair-state joint transition.
Context Attribution with Multi-Armed Bandit Optimization
Deng Pan | Keerthiram Murugesan | Ting Hua | Nuno Moniz | Nitesh V. Chawla
Findings of the Association for Computational Linguistics: ACL 2026
Deng Pan | Keerthiram Murugesan | Ting Hua | Nuno Moniz | Nitesh V. Chawla
Findings of the Association for Computational Linguistics: ACL 2026
Understanding which parts of the retrieved context contribute to a large language model’s generated answer is essential for building interpretable and trustworthy retrieval-augmented generation. We propose a novel framework that formulates context attribution as a combinatorial multi-armed bandit problem. We utilize Linear Thompson Sampling to efficiently identify the most influential context segments while minimizing the number of model queries. Our reward function leverages token log-probabilities to measure how well a subset of segments supports the original response, making it applicable to both open-source and black-box API-based models. Unlike SHAP and other perturbation-based methods that sample subsets uniformly, our approach adaptively prioritizes informative subsets based on posterior estimates of segment relevance, reducing computational costs. Experiments on multiple QA benchmarks demonstrate that our method achieves up to 30% reduction in model queries while matching or exceeding the attribution quality of existing approaches.