Training-Free Ethics-Aware Prompting and Safety- and Identity-Aware Retrieval-Augmented Generation

Junjie Zhou, Junran Wang, Ruize Tang


Abstract
Large language models are increasingly used in mental health applications, where responses must satisfy not only general safety requirements but also context-dependent ethical, professional, and jurisdictional constraints. We present a training-free inference framework for the MultiPsyche-2026 PsychEthicsEval shared task. For multiple-choice questions (Task I), the system uses ethics-aware structured prompting with independent option assessment and constrained machine-readable outputs. For open-ended questions (Task II), we introduce an identity-grounded and permission-bounded retrieval-augmented generation pipeline over curated Australian mental-health ethics resources. On the official hidden MCQ test set consisting of 282 samples, our system achieved a Partial Credit score of 0.768 (95% CI: 0.718–0.814) and an Exact Match score of 0.762. On 2,512 OEQ responses, the system obtained an ethical pass rate of 0.796 under the “rule pre-screening + classifier” evaluation and 0.621 under the independent LLM-as-a-Judge evaluation. The difference between the two OEQ evaluation scores indicates that the measurement results of open-ended ethical responses are influenced by how ethical violations are operationalized and evaluated.
Anthology ID:
2026.multipsyche-1.14
Volume:
Proceedings of the 1st Workshop on Multimodal, Multilingual, and Multicultural Mental Health and Psychotherapy (MultiPsyche)
Month:
November
Year:
2026
Address:
Hengqin, Zhuhai, China
Editors:
Zimu Wang, Yiwen Jiang, Yaling Shen, Xiangyu Zhao, Stephanie Fong, Xin Sun, Yi Zhou, Shaoxiong Ji, Robert Desimone, Barnaby Nelson, Dominic Dwyer, Zongyuan Ge
Venues:
MultiPsyche | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
173–180
Language:
URL:
https://aclanthology.org/2026.multipsyche-1.14/
DOI:
Bibkey:
Cite (ACL):
Junjie Zhou, Junran Wang, and Ruize Tang. 2026. Training-Free Ethics-Aware Prompting and Safety- and Identity-Aware Retrieval-Augmented Generation. In Proceedings of the 1st Workshop on Multimodal, Multilingual, and Multicultural Mental Health and Psychotherapy (MultiPsyche), pages 173–180, Hengqin, Zhuhai, China. Association for Computational Linguistics.
Cite (Informal):
Training-Free Ethics-Aware Prompting and Safety- and Identity-Aware Retrieval-Augmented Generation (Zhou et al., MultiPsyche 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.multipsyche-1.14.pdf