Behavioral Alignment and the Engagement for Non-Speaking Participants in Online Meetings

Trung Duc Anh Dang, Zhiqing Peng, Patrizia Paggio


Abstract
Engagement detection in meetings has focused mostly on speakers, who produce explicit prosodic and acoustic cues. The engagement of non-speaking participants is harder to read because it surfaces only in nonverbal behaviour. We predict how engaged a silent listener is, on a three-level scale (Engaged, Intermittent, Disengaged), in five-second windows of remote Zoom meetings from the GEstures and Head Movements in Language (GEHM) corpus. Each window is described by three feature families: the listener’s own nonverbal behaviour, the listener’s behavioural alignment with the others present, including the active speaker, and that speaker’s prosody. Interpersonal coordination is an established correlate of rapport and involvement. We ask the narrower question of whether a compact window-level alignment measure adds predictive value over listener-only features when confident labels are scarce. Under leakage-free cross-validation, listener-speaker alignment is the most useful addition we test, and the speaker’s terminal pitch slope is an interpretable correlate of listener engagement. The gains are modest and their bootstrap intervals include zero. Unsupervised analysis finds no engagement structure. Two findings are firmer: the task is effectively binary, actively engaged versus not, bounded by the scarcity of confident disengaged labels, and the pitch-slope correlate holds despite the small sample.
Anthology ID:
2026.mint-1.9
Volume:
Proceedings of the 1st Workshop on Multimodal Interaction in Face-to-Face Dialogue
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Esam Ghaleb, Ece Takmaz, Diego Frassinelli, Bulat Khaertdinov, Raquel Fernández, Zerrin Yumak, Asli Ozyurek
Venues:
MINT | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
78–88
Language:
URL:
https://aclanthology.org/2026.mint-1.9/
DOI:
Bibkey:
Cite (ACL):
Trung Duc Anh Dang, Zhiqing Peng, and Patrizia Paggio. 2026. Behavioral Alignment and the Engagement for Non-Speaking Participants in Online Meetings. In Proceedings of the 1st Workshop on Multimodal Interaction in Face-to-Face Dialogue, pages 78–88, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Behavioral Alignment and the Engagement for Non-Speaking Participants in Online Meetings (Dang et al., MINT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.mint-1.9.pdf