Digital Phenotyping Is Not a Shared Language: A Construct Audit of Public Mental-Health Datasets

Zefeng Sun


Abstract
Public digital-phenotyping datasets share names for behaviors and mental-health outcomes while measuring them through different devices, processing rules, and instruments. We audit StudentLife, the College Experience Study (CES), CrossCheck, and Depresjon across feature definitions, temporal aggregation, population and study design, and outcome labels. Eight CES–CrossCheck daily correspondences yield raw-unit Hellinger distances from 0.104 for time in vehicle to 0.517 for unlock duration. Sensitivity analyses change the apparent similarity of several features: mobility distance rises from 0.148 to 0.307 after soft-outlier removal. Labels span PHQ-9, PHQ-2/PHQ-4, single-item and composite EMA, and clinician-rated MADRS. The effect audit separates between-person summaries from within-person variation. Between-person phone-feature correlations are small and uncertain; within-person stillness associations are 0.082 in CES and 0.053 in CrossCheck, with different outcome definitions. Depresjon shows lower mean activity in clinical cases than controls (d = −0.547). These findings make feature definition, preprocessing, label content, and statistical estimand explicit parts of cross-dataset evaluation. We provide field-level crosswalks, aggregate results, and reconstruction scripts for multimodal mental-health research.
Anthology ID:
2026.multipsyche-1.3
Volume:
Proceedings of the 1st Workshop on Multimodal, Multilingual, and Multicultural Mental Health and Psychotherapy (MultiPsyche)
Month:
November
Year:
2026
Address:
Hengqin, Zhuhai, China
Editors:
Zimu Wang, Yiwen Jiang, Yaling Shen, Xiangyu Zhao, Stephanie Fong, Xin Sun, Yi Zhou, Shaoxiong Ji, Robert Desimone, Barnaby Nelson, Dominic Dwyer, Zongyuan Ge
Venues:
MultiPsyche | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
26–34
Language:
URL:
https://aclanthology.org/2026.multipsyche-1.3/
DOI:
Bibkey:
Cite (ACL):
Zefeng Sun. 2026. Digital Phenotyping Is Not a Shared Language: A Construct Audit of Public Mental-Health Datasets. In Proceedings of the 1st Workshop on Multimodal, Multilingual, and Multicultural Mental Health and Psychotherapy (MultiPsyche), pages 26–34, Hengqin, Zhuhai, China. Association for Computational Linguistics.
Cite (Informal):
Digital Phenotyping Is Not a Shared Language: A Construct Audit of Public Mental-Health Datasets (Sun, MultiPsyche 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.multipsyche-1.3.pdf