RSPC: A Benchmark for Modeling Stress and Psychiatric Conditions in Digitally Mediated Relationships using Psychiatrist Annotations

Parmitha Vangapandu, Sai Ganesh M, Sathwik Narkedimilli, Msvpj Sathvik, Timothy Liu, Simon See, Johannes C Eichstaedt


Abstract
In NLP, mental health conditions are often modeled as isolated phenomena, without interpersonal context. We use Reddit posts about long-distance relationships to capture both mental health distress and associated relational triggers. We introduce the Relational Stress and Psychiatry Corpus (RSPC), containing 1,799 Reddit posts annotated by psychiatrists for diagnostic categories, including the most prevalent mood disorders (anxiety and depression), relational stressor triggers, and indications of relationship phase. We benchmark seven fine-tuned transformer models and five large language models across the tasks of multi-label disorder classification, relational trigger detection, and temporal phase prediction. We find clear task-dependent differences between model families, with Claude-3-Haiku achieving the best disorder classification performance (Macro-F1 = 0.538) and GPT-4o obtaining the strongest relational trigger detection performance (Macro-F1 = 0.519), suggesting distinct model capabilities. We further find strong associations between anxiety disorders and chronic relational uncertainty. Overall, RSPC establishes a benchmark for NLP tasks that consider relational context and supports a shift from individual-centric to context-aware mental health modeling, capturing the social and temporal dynamics of distress.
Anthology ID:
2026.wnut-1.20
Volume:
Proceedings of the 11th Workshop on Natural User-generated Text
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
JinYeong Bak, Rob van der Goot, Hyeju Jang, Weerayut Buaphet, Alan Ramponi, Wei Xu, Alan Ritter
Venues:
WNUT | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
286–312
Language:
URL:
https://aclanthology.org/2026.wnut-1.20/
DOI:
Bibkey:
Cite (ACL):
Parmitha Vangapandu, Sai Ganesh M, Sathwik Narkedimilli, Msvpj Sathvik, Timothy Liu, Simon See, and Johannes C Eichstaedt. 2026. RSPC: A Benchmark for Modeling Stress and Psychiatric Conditions in Digitally Mediated Relationships using Psychiatrist Annotations. In Proceedings of the 11th Workshop on Natural User-generated Text, pages 286–312, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
RSPC: A Benchmark for Modeling Stress and Psychiatric Conditions in Digitally Mediated Relationships using Psychiatrist Annotations (Vangapandu et al., WNUT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wnut-1.20.pdf