Tracing How Annotators Think: Augmenting Preference Judgments with Reading Processes

Karin Johanna Denton de Langis, William Walker, Khanh Chi Le, Dongyeop Kang


Abstract
We propose an annotation approach that captures not only labels but also the reading process underlying annotators’ decisions, e.g., what parts of the text they focus on, re-read or skim. Using this approach, we conduct a case study on the preference annotation task and create a dataset PreferRead that contains fine-grained annotator reading behaviors obtained from mouse tracking. PreferRead enables detailed analysis of how annotators navigate between a prompt and two candidate responses before selecting their preference. We find that annotators re-read a response in roughly half of all trials, most often revisiting the option they ultimately choose, and rarely revisit the prompt. Reading behaviors are also significantly related to annotation outcomes: re-reading is associated with higher inter-annotator agreement, whereas long reading paths and times are associated with lower agreement. These results demonstrate that reading processes provide a complementary cognitive dimension for understanding annotator reliability, decision-making and disagreement in complex, subjective NLP tasks.
Anthology ID:
2026.lrec-1.510
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
6428–6438
Language:
External URL:
https://lrec.elra.info/lrec2026-main-510
DOI:
10.63317/3nrqhnhixp4j
Bibkey:
Cite (ACL):
Karin Johanna Denton de Langis, William Walker, Khanh Chi Le, and Dongyeop Kang. 2026. Tracing How Annotators Think: Augmenting Preference Judgments with Reading Processes. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 6428–6438, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
Tracing How Annotators Think: Augmenting Preference Judgments with Reading Processes (de Langis et al., LREC 2026)
Copy Citation: