Steven Euijong Whang
Author directory2026
DeFrame: Debiasing Large Language Models Against Framing Effects
Kahee Lim | Soyeon Kim | Steven Euijong Whang
Findings of the Association for Computational Linguistics: ACL 2026
Kahee Lim | Soyeon Kim | Steven Euijong Whang
Findings of the Association for Computational Linguistics: ACL 2026
As large language models (LLMs) are increasingly deployed in real-world applications, ensuring their fair responses across demographics has become crucial. Despite many efforts, an ongoing challenge is hidden bias: LLMs appear fair under standard evaluations, but can produce biased responses outside those evaluation settings. In this paper, we identify framing – differences in how semantically equivalent prompts are expressed (e.g., “A is better than B” vs. “B is worse than A”) – as an underexplored contributor to this gap. We first introduce the concept of “framing disparity” to quantify the impact of framing on fairness evaluation. By augmenting fairness evaluation benchmarks with alternative framings, we find that (1) fairness scores vary significantly with framing and (2) existing debiasing methods improve overall (i.e., frame-averaged) fairness, but often fail to reduce framing-induced disparities. To address this, we propose a framing-aware debiasing method that encourages LLMs to be more consistent across framings. Experiments demonstrate that our approach reduces overall bias and improves robustness against framing disparities, enabling LLMs to produce fairer and more consistent responses.
Q-TIE: A Lightweight and Generalizable Re-ranking Framework for Temporal Information Retrieval
Soyeon Kim | HyunJin Kim | JinYeong Bak | Steven Euijong Whang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Soyeon Kim | HyunJin Kim | JinYeong Bak | Steven Euijong Whang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Temporal Information Retrieval (TIR) has been increasingly critical given the rise of Retrieval-Augmented Generation (RAG). Since temporally mismatched evidence can be highly misleading, TIR aims to retrieve documents that are both semantically and temporally relevant to a query. Two TIR paradigms have emerged – temporal retrievers and temporal re-rankers – differing in how temporal relevance is modeled. While these paradigms provide complementary strengths, our analysis reveals that each alone falls short of robust TIR: temporal retrievers provide flexible query understanding via learned representations, but often fail to explicitly account for temporal constraints; temporal re-rankers can enforce such constraints more explicitly, but often rely on predefined re-ranking rules. To address this, we propose Q-TIE, a re-ranking framework based on learned Temporal Intent Extraction (TIE). By introducing a TIE model that maps each query’s temporal constraint into a unified interval representation (i.e., ⟨ tstart, tend ⟩), Q-TIE generalizes beyond predefined rules via model-based learning while explicitly modeling temporal constraints as a separate signal – jointly achieving what each paradigm typically trades off. Experiments demonstrate that Q-TIE consistently outperforms existing TIR methods with stronger generalizability across temporal query types, and provides a lightweight yet effective add-on for temporally-aware RAG pipelines.