CLAAS: Conditional LVLM-enabled Attribute-Aware response Simulation for Public Health Education

Anh N Nhu, Jenna Yang, Laura Yu Zheng, Sylvette La Touche-Howard, Tracy M. Zeeger, Ming Lin


Abstract
Modeling how diverse communities respond to public health messages is critical for training students to design targeted communication materials. However, no method is currently available to iteratively evaluate how different populations may perceive their campaign designs before human-subject testing. Despite progress in VLM/LLM-based psychometric simulation, community simulators for public health education remain largely unexplored. We reframe VLMs as attribute-aware community response simulators and introduce CLAAS, to our knowledge the first multimodal response simulation tool for public-health higher education. CLAAS aligns open-source VLMs, such as Gemma3, Llama-3.2, and Qwen2.5-VL, with an in-house survey dataset of 33K+ responses from 1K+ participants to simulate trait-conditioned emotional, behavioral, and sentimental responses. Quantitatively, attribute-aligned VLMs consistently outperform zero-shot and random baselines and generalize to unseen communication strategies. Beyond dataset evaluation, our pilot studies in real course sessions across two semesters demonstrate CLAAS’s potential practical relevance in educational settings. Most students reported CLAAS provided useful feedback and generated responses aligned with their expectations. This study suggests attribute-aware VLM support experiential public health education and promote a socially impactful research direction: interactive population simulator for community-centered communication design.
Anthology ID:
2026.emnlp-main.2007
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
45706–45746
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2007/
DOI:
Bibkey:
Cite (ACL):
Anh N Nhu, Jenna Yang, Laura Yu Zheng, Sylvette La Touche-Howard, Tracy M. Zeeger, and Ming Lin. 2026. CLAAS: Conditional LVLM-enabled Attribute-Aware response Simulation for Public Health Education. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 45706–45746, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
CLAAS: Conditional LVLM-enabled Attribute-Aware response Simulation for Public Health Education (Nhu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2007.pdf