<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="radhe-galatolo-2026-hidden">
    <titleInfo>
        <title>The Hidden Cost of Personality: How Conditioning Methods Disrupt Gesture Generation in Small Language Models</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Tova</namePart>
        <namePart type="family">Radhe</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Alessio</namePart>
        <namePart type="family">Galatolo</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2026-10</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 1st Workshop on Multimodal Interaction in Face-to-Face Dialogue</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Esam</namePart>
            <namePart type="family">Ghaleb</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ece</namePart>
            <namePart type="family">Takmaz</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Diego</namePart>
            <namePart type="family">Frassinelli</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Bulat</namePart>
            <namePart type="family">Khaertdinov</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Raquel</namePart>
            <namePart type="family">Fernández</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Zerrin</namePart>
            <namePart type="family">Yumak</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Asli</namePart>
            <namePart type="family">Ozyurek</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Budapest, Hungary</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-8-89176-482-8</identifier>
    </relatedItem>
    <abstract>Personality is a key factor in human–agent and human-robot interaction, influencing user perception, trust, and engagement. This work investigates methods for inducing Big Five personality traits in (open) language models, with a focus on smaller variants as more easily deployable in real-time agents and robotic systems. We compare prompt-based conditioning, parameter-efficient fine-tuning, and activation steering, focusing on their behaviour in multi-turn dialogue and embodied gesture generation. In particular, we investigate personality drift across turns and non-verbal behaviour generation through direct function calls.\par We find that classifier-assigned trait alignment differs little across methods, with no consistent evidence of trait drift over multi-turn interaction. However, conditioning method significantly affects dialogue quality and robustness, with steering and fine-tuning introducing artefacts and instability. Interestingly, the more consequential differences emerge in the multimodal channel. Conditioning method, not intended personality, is the dominant driver of gesture behaviour, reshaping gesture diversity, tool-use reliability, and output-gesture congruence. Our findings suggest that personality conditioning should be evaluated jointly across verbal and non-verbal channels, and that method choice is itself a design decision shaping the expressiveness and reliability of embodied conversational agents.</abstract>
    <identifier type="citekey">radhe-galatolo-2026-hidden</identifier>
    <location>
        <url>https://aclanthology.org/2026.mint-1.17/</url>
    </location>
    <part>
        <date>2026-10</date>
        <extent unit="page">
            <start>160</start>
            <end>174</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T The Hidden Cost of Personality: How Conditioning Methods Disrupt Gesture Generation in Small Language Models
%A Radhe, Tova
%A Galatolo, Alessio
%Y Ghaleb, Esam
%Y Takmaz, Ece
%Y Frassinelli, Diego
%Y Khaertdinov, Bulat
%Y Fernández, Raquel
%Y Yumak, Zerrin
%Y Ozyurek, Asli
%S Proceedings of the 1st Workshop on Multimodal Interaction in Face-to-Face Dialogue
%D 2026
%8 October
%I Association for Computational Linguistics
%C Budapest, Hungary
%@ 979-8-89176-482-8
%F radhe-galatolo-2026-hidden
%X Personality is a key factor in human–agent and human-robot interaction, influencing user perception, trust, and engagement. This work investigates methods for inducing Big Five personality traits in (open) language models, with a focus on smaller variants as more easily deployable in real-time agents and robotic systems. We compare prompt-based conditioning, parameter-efficient fine-tuning, and activation steering, focusing on their behaviour in multi-turn dialogue and embodied gesture generation. In particular, we investigate personality drift across turns and non-verbal behaviour generation through direct function calls.\par We find that classifier-assigned trait alignment differs little across methods, with no consistent evidence of trait drift over multi-turn interaction. However, conditioning method significantly affects dialogue quality and robustness, with steering and fine-tuning introducing artefacts and instability. Interestingly, the more consequential differences emerge in the multimodal channel. Conditioning method, not intended personality, is the dominant driver of gesture behaviour, reshaping gesture diversity, tool-use reliability, and output-gesture congruence. Our findings suggest that personality conditioning should be evaluated jointly across verbal and non-verbal channels, and that method choice is itself a design decision shaping the expressiveness and reliability of embodied conversational agents.
%U https://aclanthology.org/2026.mint-1.17/
%P 160-174

Markdown (Informal)

[The Hidden Cost of Personality: How Conditioning Methods Disrupt Gesture Generation in Small Language Models](https://aclanthology.org/2026.mint-1.17/) (Radhe & Galatolo, MINT 2026)

• The Hidden Cost of Personality: How Conditioning Methods Disrupt Gesture Generation in Small Language Models (Radhe & Galatolo, MINT 2026)

ACL

• Tova Radhe and Alessio Galatolo. 2026. The Hidden Cost of Personality: How Conditioning Methods Disrupt Gesture Generation in Small Language Models. In Proceedings of the 1st Workshop on Multimodal Interaction in Face-to-Face Dialogue, pages 160–174, Budapest, Hungary. Association for Computational Linguistics.