MAPS: Robot-Mediated Multimodal Mental Health Screening for Chinese Adolescents

Zhicheng Du, Yang Liu, Zheng Chen, Zhuo Deng, Zhaotian Xie, Wenji Xi, Xi Yuan, Zhen Liang, Dongmei Yu, Chenggang Yan, Jiansong Ji, Peiwu Qin, Zhenglin Chen, Lan Ma


Abstract
We present an initial study of robot-mediated multimodal mental-health screening for Chinese adolescents aged 12–15. MAPS (Multimodal Adolescent Psychological Screening) combines facial, acoustic, textual, and remotely estimated physiological signals collected through a standardized protocol of questionnaires, emotionally evocative tasks, and question answering. From 3,783 participants, 968 records were retained after consent, completeness, and quality-control filtering. We introduce GAME (Generalized Model with Attention and Multimodal EmbraceNet), a fusion model combining eight unimodal representations with relation-graph and attention features. Separate models are trained for 12 questionnaire- and expert-derived screening targets. Stratified 10-fold cross-validation yields 73.04–92.77% accuracy and 71.32–91.06% weighted F1. Feature ablations and descriptive contribution analyses suggest that representation use varies across targets. This initial study connects a portable interaction protocol with task-specific multimodal modeling in a Chinese school setting and provides a basis for further research on screening-label prediction. Future work will expand data collection, refine the fusion and training procedures, and evaluate generalization and screening utility through external and clinically supervised validation.
Anthology ID:
2026.multipsyche-1.7
Volume:
Proceedings of the 1st Workshop on Multimodal, Multilingual, and Multicultural Mental Health and Psychotherapy (MultiPsyche)
Month:
November
Year:
2026
Address:
Hengqin, Zhuhai, China
Editors:
Zimu Wang, Yiwen Jiang, Yaling Shen, Xiangyu Zhao, Stephanie Fong, Xin Sun, Yi Zhou, Shaoxiong Ji, Robert Desimone, Barnaby Nelson, Dominic Dwyer, Zongyuan Ge
Venues:
MultiPsyche | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
69–79
Language:
URL:
https://aclanthology.org/2026.multipsyche-1.7/
DOI:
Bibkey:
Cite (ACL):
Zhicheng Du, Yang Liu, Zheng Chen, Zhuo Deng, Zhaotian Xie, Wenji Xi, Xi Yuan, Zhen Liang, Dongmei Yu, Chenggang Yan, Jiansong Ji, Peiwu Qin, Zhenglin Chen, and Lan Ma. 2026. MAPS: Robot-Mediated Multimodal Mental Health Screening for Chinese Adolescents. In Proceedings of the 1st Workshop on Multimodal, Multilingual, and Multicultural Mental Health and Psychotherapy (MultiPsyche), pages 69–79, Hengqin, Zhuhai, China. Association for Computational Linguistics.
Cite (Informal):
MAPS: Robot-Mediated Multimodal Mental Health Screening for Chinese Adolescents (Du et al., MultiPsyche 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.multipsyche-1.7.pdf