Ziyi Wang
Author directoryOther people with similar names: Ziyi Wang, Ziyi Wang, Ziyi Wang, Ziyi Wang, Ziyi Wang
Unverified author pages with similar names: Ziyi Wang
2026
MeetingToM: Evaluating Multimodal LLMs on Theory-of-Mind Reasoning in Multi-Party Meetings
Ziyi Wang | Yuhang Wu | Dongxu Piao | Xingyu Liu | Tianhui Zhou | Miao Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Ziyi Wang | Yuhang Wu | Dongxu Piao | Xingyu Liu | Tianhui Zhou | Miao Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Theory of Mind (ToM), the ability to infer others’ beliefs, intentions, and states of knowledge, is central to social interaction, yet remains challenging for current Multimodal Large Language Models (MLLMs), especially in multi-party meetings where cues are distributed across speech and behavior. Existing multimodal ToM benchmarks mainly focus on video-grounded question answering over overt, externally verifiable signals, and provide limited coverage of nuanced social states and group dynamics. We introduce MeetingToM, a benchmark for complex social behavior reasoning in naturalistic multi-party meetings. MeetingToM targets meeting-specific phenomena such as pseudo-consensus, where apparent agreement co-occurs with cues of dissent under social pressure. The benchmark is hierarchically organized to evaluate ToM at increasing levels of social granularity, including (i) subject-level mental state prediction, (ii) dyadic-level addressee understanding, and (iii) group-level consensus reasoning. We provide a unified evaluation protocol and conduct systematic analyses of representative MLLMs, revealing persistent limitations in integrating non-verbal cues, predicting annotated attitudes, and distinguishing among consensus states. Our results highlight key challenges and establish MeetingToM as a testbed for advancing meeting-grounded ToM in multimodal models. Project page: https://oliviaziyi.github.io/MeetingToM-Project-Page/