An Honesty-Aware Multi-Agent Framework for Synthetic Psychiatric Intake Data Generation

Xinyuan Zhang, Chang Dao, Zijian Wang, Yechao Pang, Juexiao Zhou


Abstract
Psychiatric intake combines self-report scales with clinician-rated interviewing, but public full-trace data are scarce and most synthetic resources assume truthful reporting. We present an honesty-aware multi-agent framework for psychiatric intake simulation that explicitly models honest reporting, concealment, and malingering under asymmetric information. Starting from structured patient profiles, five role-specific agents generate self-report scale outputs, strategy-guided clinician-rated interviews, honesty inference from the interview transcript alone, and honesty-aware diagnostic fusion over four common psychiatric domains: major depressive disorder (MDD), anxiety disorder (AD), bipolar disorder (BD), and attention-deficit/hyperactivity disorder (ADHD). Using normalized clinical and healthy source profiles, we construct a dataset of 2,008 complete intake sessions with 58,918 dialogue turns, linking profiles, scales, strategy traces, inferred honesty, and final diagnostic reports. Experiments show that assigned reporting conditions are expressed in generated patient behavior and can be recovered from the interview transcript alone, with condition-level inference accuracy between 60.1% and 94.8%. Under hidden-information constraints, the best LLM achieves 85.4% exact recovery of synthetic reference domains with 0.99 severity MAE and zero detected leakage. Honesty-aware fusion reduces deviation from benchmark reference labels relative to self-report alone, and strategy-guided interviewing attains higher accuracy with fewer evaluator questions than item-by-item questioning. These results support honesty-aware synthetic intake data as a controlled research benchmark, not a clinically validated pre-assessment system.
Anthology ID:
2026.findings-emnlp.2334
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
50172–50198
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2334/
DOI:
Bibkey:
Cite (ACL):
Xinyuan Zhang, Chang Dao, Zijian Wang, Yechao Pang, and Juexiao Zhou. 2026. An Honesty-Aware Multi-Agent Framework for Synthetic Psychiatric Intake Data Generation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 50172–50198, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
An Honesty-Aware Multi-Agent Framework for Synthetic Psychiatric Intake Data Generation (Zhang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2334.pdf