PRIVaThe: An Annotated Dataset of Multi-Objectives Web Search Sessions

Claire Ibarboure, Ludovic Tanguy, Franck Amadieu, Josiane Mothe


Abstract
This paper presents PRIVaThe, a new French-language dataset, consisting of 200 web search sessions from 100 participants performing two multi-objective, multi-hop tasks, designed to enable cross-user comparison of session-level search strategies. Unlike existing datasets that capture only query sequences or final answers, PRIVaThe provides explicit sub-objective decomposition traces for each session. We automatically annotate 3,162 queries with their addressed sub-objective(s) using validated open-weight LLMs (Mistral, LLama3, and Gemma) against human gold annotations. This annotation enables systematic analyses of how users distribute and sequence sub-objectives throughout their sessions, revealing distinct search strategies such as logical, global, and exploratory approaches.
Anthology ID:
2026.lrec-1.584
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
7380–7390
Language:
External URL:
https://lrec.elra.info/lrec2026-main-584
DOI:
10.63317/2n7axdztewkz
Bibkey:
Cite (ACL):
Claire Ibarboure, Ludovic Tanguy, Franck Amadieu, and Josiane Mothe. 2026. PRIVaThe: An Annotated Dataset of Multi-Objectives Web Search Sessions. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 7380–7390, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
PRIVaThe: An Annotated Dataset of Multi-Objectives Web Search Sessions (Ibarboure et al., LREC 2026)
Copy Citation: