OMIT the Action: Measuring Framing-Invariant Omission Bias under Philosophical Disagreement

Sihyeon Lee, Jihun Song, Chanwoo Kim, Jiwoo Kum, Chanjun Park


Abstract
As LLMs increasingly assist in moral reasoning, omission bias, the tendency to prefer inaction even when equivalent framings reverse substantive outcomes, poses a significant risk of skewed decision-making. Yet omission bias remains underexplored in LLM evaluation, with the few existing studies limited in scale and focused largely on utilitarian-deontological conflicts. To address this gap, we introduce OMIT, a benchmark consisting of 218 paired-frame scenarios across 10 conflict types, constructed by leveraging disagreement patterns from an LLM-based, five-perspective philosophical persona panel (utilitarianism, deontology, virtue ethics, care ethics, and contractualism). Evaluating eight LLMs, we find that omission bias is pervasive but inversely correlates with model size within families. We further evaluate four inference-time interventions and find that interventions encouraging models to consider moral principles before committing to a yes/no answer reduce omission bias and increase frame-consistent responses, although lower omission bias rates can also coincide with shifts toward action-biased responses. Ultimately, this work contributes not only the OMIT benchmark, but also a methodology for using diverse philosophical disagreement signals to evaluate framing-sensitive inaction preferences and the distributional effects of mitigation attempts in LLMs under complex moral conflicts.
Anthology ID:
2026.findings-aacl.167
Volume:
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3314–3334
Language:
URL:
https://aclanthology.org/2026.findings-aacl.167/
DOI:
Bibkey:
Cite (ACL):
Sihyeon Lee, Jihun Song, Chanwoo Kim, Jiwoo Kum, and Chanjun Park. 2026. OMIT the Action: Measuring Framing-Invariant Omission Bias under Philosophical Disagreement. In Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026, pages 3314–3334, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
OMIT the Action: Measuring Framing-Invariant Omission Bias under Philosophical Disagreement (Lee et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-aacl.167.pdf