A Modeling Study of the Effects of Surprisal and Entropy in Perceptual Decision Making of an Adaptive Agent

Pyeong Whan Cho, Richard Lewis


Abstract
Processing difficulty in online language comprehension has been explained in terms of surprisal and entropy reduction. Although both hypotheses have been supported by experimental data, we do not fully understand their relative contributions on processing difficulty. To develop a better understanding, we propose a mechanistic model of perceptual decision making that interacts with a simulated task environment with temporal dynamics. The proposed model collects noisy bottom-up evidence over multiple timesteps, integrates it with its top-down expectation, and makes perceptual decisions, producing processing time data directly without relying on any linking hypothesis. Temporal dynamics in the task environment was determined by a simple finite-state grammar, which was designed to create the situations where the surprisal and entropy reduction hypotheses predict different patterns. After the model was trained to maximize rewards, the model developed an adaptive policy and both surprisal and entropy effects were observed especially in a measure reflecting earlier processing.
Anthology ID:
W19-2906
Volume:
Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota
Venue:
CMCL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
53–61
Language:
URL:
https://aclanthology.org/W19-2906
DOI:
10.18653/v1/W19-2906
Bibkey:
Cite (ACL):
Pyeong Whan Cho and Richard Lewis. 2019. A Modeling Study of the Effects of Surprisal and Entropy in Perceptual Decision Making of an Adaptive Agent. In Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, pages 53–61, Minneapolis, Minnesota. Association for Computational Linguistics.
Cite (Informal):
A Modeling Study of the Effects of Surprisal and Entropy in Perceptual Decision Making of an Adaptive Agent (Cho & Lewis, CMCL 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-2906.pdf