Do LLMs Choose Like Humans? Using Cognitive Theory to Evaluate LLM Decision-Making

Johnathan Sun, Andrei Shleifer, Yonatan Belinkov


Abstract
Large language models (LLMs) exhibit a range of human-like decision-making behaviors, but whether these reflect similar underlying mechanisms or surface-level mimicry remains unclear. We evaluate whether LLM context sensitivity aligns with a cognitive economic theory that explains human behavior through problem categorization and attention allocation. Across 12 open-source and commercial LLMs on a novel 140,000-trial product choice benchmark, context induces human-like shifts in choice and problem categorization, but does not reliably reweight attention between features like price and quality. Neither scale nor chain-of-thought reasoning reliably attenuates context sensitivity or generates human-like behavior. These results suggest that LLM decision mechanisms are distinct from human ones.
Anthology ID:
2026.findings-emnlp.2177
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
46552–46569
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2177/
DOI:
10.18653/2026.findings-emnlp.2177
Bibkey:
Cite (ACL):
Johnathan Sun, Andrei Shleifer, and Yonatan Belinkov. 2026. Do LLMs Choose Like Humans? Using Cognitive Theory to Evaluate LLM Decision-Making. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 46552–46569, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Do LLMs Choose Like Humans? Using Cognitive Theory to Evaluate LLM Decision-Making (Sun et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2177.pdf