RoleEthic: Structured Prompting and Failure Analysis for Open-Ended Mental Health Ethics

Meiyi Qi


Abstract
Open-ended mental health ethics questions require models to balance stakeholder interests, ethical constraints, and conflicting courses of action. We present RoleEthic, a fourteen-stage structured prompting framework for the Open-Ended Question (OEQ) track of the PsychEthicsEval shared task at MultiPsyche 2026. The stages organize reasoning around case facts, stakeholder relationships and perspectives, and the AI’s role; gather and classify ethical considerations, apply a bottom-line check, and prioritize concerns; and guide response drafting and review for ethical consistency, role consistency, unsupported high-impact claims, and risky details. The framework runs within a single Qwen3-30B-A3B model call without explicit role labels or external verification and returns only the final response. In the official Phase 2 evaluation, RoleEthic achieves ethical rates of 0.562 under the rule pre-filter plus ModernBERT classifier approach and 0.522 under the GPT-5-mini judge approach, placing third among three submissions under each approach. Output diagnostics identify verbosity and additional contact-like details, while three purposively selected cases illustrate unsupported jurisdictional claims and role inconsistency in final responses.
Anthology ID:
2026.multipsyche-1.15
Volume:
Proceedings of the 1st Workshop on Multimodal, Multilingual, and Multicultural Mental Health and Psychotherapy (MultiPsyche)
Month:
November
Year:
2026
Address:
Hengqin, Zhuhai, China
Editors:
Zimu Wang, Yiwen Jiang, Yaling Shen, Xiangyu Zhao, Stephanie Fong, Xin Sun, Yi Zhou, Shaoxiong Ji, Robert Desimone, Barnaby Nelson, Dominic Dwyer, Zongyuan Ge
Venues:
MultiPsyche | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
181–185
Language:
URL:
https://aclanthology.org/2026.multipsyche-1.15/
DOI:
Bibkey:
Cite (ACL):
Meiyi Qi. 2026. RoleEthic: Structured Prompting and Failure Analysis for Open-Ended Mental Health Ethics. In Proceedings of the 1st Workshop on Multimodal, Multilingual, and Multicultural Mental Health and Psychotherapy (MultiPsyche), pages 181–185, Hengqin, Zhuhai, China. Association for Computational Linguistics.
Cite (Informal):
RoleEthic: Structured Prompting and Failure Analysis for Open-Ended Mental Health Ethics (Qi, MultiPsyche 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.multipsyche-1.15.pdf