The Label-Translation Fallacy: A Four-Layer Validity Protocol for Multilingual Mental Health NLP

Wajdi Zaghouani


Abstract
A familiar paper translates an English screener, fits a classifier to the new labels, reports a strong F1, and claims to detect depression in another language community. Standard metrics can look fine while construct equivalence, instrument adaptation, and annotation ecology remain unshown. We call this the label-translation fallacy. Building on unified validity theory, measurement modeling, data statements, and cultural psychiatry, we propose a four-layer reporting protocol (construct, instrument, annotation ecology, and licensed claim) for authors and reviewers at venues such as MultiPsyche. We provide minimal evidence thresholds grounded in COSMIN and psychometric standards, concrete templates for L3 annotation reporting, and a decision tree for mapping evidence to claims. Three one-pass case studies show operationalizability. The contribution is integrative rather than experimental: we combine existing validity tools into an operational checklist so that multilingual mental health metrics are interpreted only as strongly as their constructs allow.
Anthology ID:
2026.multipsyche-1.5
Volume:
Proceedings of the 1st Workshop on Multimodal, Multilingual, and Multicultural Mental Health and Psychotherapy (MultiPsyche)
Month:
November
Year:
2026
Address:
Hengqin, Zhuhai, China
Editors:
Zimu Wang, Yiwen Jiang, Yaling Shen, Xiangyu Zhao, Stephanie Fong, Xin Sun, Yi Zhou, Shaoxiong Ji, Robert Desimone, Barnaby Nelson, Dominic Dwyer, Zongyuan Ge
Venues:
MultiPsyche | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
44–54
Language:
URL:
https://aclanthology.org/2026.multipsyche-1.5/
DOI:
Bibkey:
Cite (ACL):
Wajdi Zaghouani. 2026. The Label-Translation Fallacy: A Four-Layer Validity Protocol for Multilingual Mental Health NLP. In Proceedings of the 1st Workshop on Multimodal, Multilingual, and Multicultural Mental Health and Psychotherapy (MultiPsyche), pages 44–54, Hengqin, Zhuhai, China. Association for Computational Linguistics.
Cite (Informal):
The Label-Translation Fallacy: A Four-Layer Validity Protocol for Multilingual Mental Health NLP (Zaghouani, MultiPsyche 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.multipsyche-1.5.pdf