A Dataset of Psychiatric Hospital Notes with Temporal Information Annotations

Timothy A. Miller, Gaby Dinh, David Harris, WonJin Yoon, Spencer Thomas, Boyu Ren, Meihua Hall, Guergana Savova


Abstract
Temporal information extraction is the task of identifying temporal entities in a text and relating them to each other. In medicine, electronic health records (EHRs) contain text that documents the sequence of events during an encounter with a patient, and sometimes the events prior to the encounter (e.g., social history). Temporality is especially important for the specialty of psychiatry. In this work, we describe the updates to the guidelines that allowed us to create a corpus of temporally-annotated psychiatric discharge summaries and progress notes. These updated guidelines were used to create a corpus of over 18000 events, 2200 time expressions, and 13,000 temporal relations. Temporal information extraction performance with a baseline system trained on non-psychiatric data obtains an F1 score of 0.152 on relation extraction, indicating the importance of this new dataset for making progress on temporal information extraction in the psychiatric domain.
Anthology ID:
2026.lrec-1.592
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
7479–7484
Language:
External URL:
https://lrec.elra.info/lrec2026-main-592
DOI:
10.63317/4pj6fbqovg3f
Bibkey:
Cite (ACL):
Timothy A. Miller, Gaby Dinh, David Harris, WonJin Yoon, Spencer Thomas, Boyu Ren, Meihua Hall, and Guergana Savova. 2026. A Dataset of Psychiatric Hospital Notes with Temporal Information Annotations. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 7479–7484, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
A Dataset of Psychiatric Hospital Notes with Temporal Information Annotations (Miller et al., LREC 2026)
Copy Citation: