Yutong Song
Author directory2026
DementiaBank-Emotion: A Multi-Rater Emotion Annotation Corpus for Alzheimer’s Disease Speech (Version 1.0)
Cheonkam Jeong | Jessica Liao | Audrey Lu | Yutong Song | Christopher Rashidian | Donna Krogh | Erik Krogh | Mahkameh Rasouli | Jung-Ah Lee | Nikil Dutt | Lisa M Gibbs | David Sultzer | Julie Rousseau | Jocelyn Ludlow | Margaret Galvez | Alexander Nuth | Chet Khay | Sabine Brunswicker | Adeline Nyamathi
Proceedings of the 1st Workshop on Linguistic Analysis for Health (HeaLing 2026)
Cheonkam Jeong | Jessica Liao | Audrey Lu | Yutong Song | Christopher Rashidian | Donna Krogh | Erik Krogh | Mahkameh Rasouli | Jung-Ah Lee | Nikil Dutt | Lisa M Gibbs | David Sultzer | Julie Rousseau | Jocelyn Ludlow | Margaret Galvez | Alexander Nuth | Chet Khay | Sabine Brunswicker | Adeline Nyamathi
Proceedings of the 1st Workshop on Linguistic Analysis for Health (HeaLing 2026)
We present DementiaBank-Emotion, the first multi-rater emotion annotation corpus for Alzheimer’s disease (AD) speech. Annotating 1,492 utterances from 108 speakers for Ekman’s six basic emotions and neutral, we find that AD patients express significantly more non-neutral emotions (16.9%) than healthy controls (5.7%; p < .001). Exploratory acoustic analysis suggests a possible dissociation: control speakers showed substantial F0 modulation for sadness (Delta = -3.45 semitones from baseline), whereas AD speakers showed minimal change (Delta = +0.11 semitones; interaction p = .023), though this finding is based on limited samples (sadness: n=5 control, n=15 AD) and requires replication. Within AD speech, loudness differentiates emotion categories, indicating partially preserved emotion-prosody mappings. We release the corpus, annotation guidelines, and calibration workshop materials to support research on emotion recognition in clinical populations.
CARD: Cluster-level Adaptation with Reward-guided Decoding for Personalized Text Generation
Yutong Song | Jiang Wu | Weijia Zhang | Chengze Shen | Shaofan Yuan | Weitao Lu | Jian Wang | Yu Wang | Nikil Dutt | Amir M. Rahmani
Findings of the Association for Computational Linguistics: EMNLP 2026
Yutong Song | Jiang Wu | Weijia Zhang | Chengze Shen | Shaofan Yuan | Weitao Lu | Jian Wang | Yu Wang | Nikil Dutt | Amir M. Rahmani
Findings of the Association for Computational Linguistics: EMNLP 2026
Adapting large language models to individual users remains challenging because systems must capture fine-grained personal preferences while serving many users efficiently. We introduce CARD, a hierarchical personalization framework that first learns preferences shared across user groups and then captures how individual users depart from those shared patterns. CARD trains a parameter-efficient adaptation module for each group, providing a reliable prior even when a user has limited history. It then learns a compact user preference vector by contrasting user-authored responses with outputs from the corresponding group model, without requiring manual annotations. During inference, both the backbone and the group adaptation module remain frozen, while the user vector applies a low-rank correction to the token logits during decoding. Experiments on personalization benchmarks show that CARD consistently outperforms competitive baselines while requiring only a compact vector for each user.
DemMA: Dementia Multi-Turn Dialogue Agent with Expert-Guided Reasoning and Action Simulation
Yutong Song | Jiang Wu | Kazi Shaharair Sharif | Pengfei Zhang | Wenjun Huang | Honghui Xu | Nikil Dutt | Amir M. Rahmani
Findings of the Association for Computational Linguistics: ACL 2026
Yutong Song | Jiang Wu | Kazi Shaharair Sharif | Pengfei Zhang | Wenjun Huang | Honghui Xu | Nikil Dutt | Amir M. Rahmani
Findings of the Association for Computational Linguistics: ACL 2026
Simulating dementia patients with large language models (LLMs) is challenging due to the need to jointly model cognitive impairment, emotional dynamics, and nonverbal behaviors over long conversations. We present DemMA, an expert-guided dementia dialogue agent for high-fidelity multi-turn patient simulation. DemMA constructs clinically grounded dementia personas by integrating pathology information, personality traits, and subtype-specific memory-status personas informed by clinical experts. To move beyond text-only simulation, DemMA explicitly models nonverbal behaviors, including motion, facial expressions, and vocal cues. We further introduce a Chain-of-Thought distillation framework that trains a single LLM to jointly generate reasoning traces, patient utterances, and aligned behavioral actions within one forward pass, enabling efficient deployment without multi-agent inference.
Do Implicit Personalization and Explicit Styles Conflict? PsPLUG: A Lightweight Plug-in for Balancing Personalization and Style in Customized LLMs
Yutong Song | Jiang Wu | Shaofan Yuan | Chengze Shen | Jian Wang | Yu Wang | Nikil Dutt | Amir M. Rahmani
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yutong Song | Jiang Wu | Shaofan Yuan | Chengze Shen | Jian Wang | Yu Wang | Nikil Dutt | Amir M. Rahmani
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Personalized large language models are often expected to follow explicit style instructions, yet we find that such instructions can undermine the user-specific characteristics that personalization methods aim to preserve. We call this failure mode personalization collapse: explicit style control can conflict with implicit user preferences. To address this challenge, we propose PsPLUG, a lightweight plug-in that learns a user-specific residual after accounting for the requested style. PsPLUG also allows us to tune personalization strength at inference time. Our experiments show that explicit style instructions can diminish personalization in existing methods, whereas PsPLUG better preserves user preferences while providing precise control over the balance between personalization and style adherence.
AP-GRPO: Anchor-Gated Phonetic Alignment with Policy Optimization for Pathological Speech Reconstruction
Pengfei Zhang | Hoang H Nguyen | Yutong Song | Wenjun Huang | Tahmid Imtiaz Imu | Henry Peng Zou | Jiang Wu | Honghui Xu | Amir M. Rahmani
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Pengfei Zhang | Hoang H Nguyen | Yutong Song | Wenjun Huang | Tahmid Imtiaz Imu | Henry Peng Zou | Jiang Wu | Honghui Xu | Amir M. Rahmani
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Pathological speech from patients with neurodegenerative and neuromotor disorders is often acoustically distorted and linguistically fragmented, making pathological speech reconstruction necessary to recover intended textual content from distorted and incomplete speech recordings. Crucially, such recordings are rarely uniformly degraded: some words or short phrases remain reliable and can serve as audible anchors for reconstructing the corrupted surrounding content. We introduce **Anchor-gated Phonetic Group Relative Policy Optimization (AP-GRPO)**, a GRPO framework with phonetic reward that aligns speech language models (SLMs) through audible-anchor preservation and inter-anchor phonetic compatibility to the original speech signal. AP-GRPO consists of: (i) an **anchor-gated reward** that matches reliable audible anchors in clear regions; and (ii) an **inter-anchor phonetic alignment reward** that evaluates whether recovered contents are phonetically supported by the corresponding corrupted inter-anchor speech span. Across four disease conditions, AP-GRPO improves faithful speech reconstruction, and the learned anchor constraint automatically adapts to each condition and thus reveals interpretable disease-specific profiles: conditions with severe articulatory degradation require stronger anchor enforcement, whereas milder impairment or linguistically impaired conditions rely more on phonetic alignment for inter-anchor recovery.
Search
Fix author
Co-authors
- Nikil Dutt 4
- Amir M. Rahmani 4
- Jiang Wu 4
- Wenjun Huang 2
- Chengze Shen 2
- Jian Wang 2
- Yu Wang 2
- Honghui Xu 2
- Shaofan Yuan 2
- Pengfei Zhang 2
- Sabine Brunswicker 1
- Margaret Galvez 1
- Lisa M Gibbs 1
- Tahmid Imtiaz Imu 1
- Cheonkam Jeong 1
- Chet Khay 1
- Donna Krogh 1
- Erik Krogh 1
- Jung-Ah Lee 1
- Jessica Liao 1
- Audrey Lu 1
- Weitao Lu 1
- Jocelyn Ludlow 1
- Hoang H Nguyen 1
- Alexander Nuth 1
- Adeline Nyamathi 1
- Christopher Rashidian 1
- Mahkameh Rasouli 1
- Julie Rousseau 1
- Kazi Shaharair Sharif 1
- David Sultzer 1
- Weijia Zhang 1
- Henry Peng Zou 1