SENSESHIFT: Continuous Sentiment-Controlled Text generation via Encoder-based Mask Infilling

Shahed Masoudian, Markus Frohmann, Emmanouil Karystinaios, Navid Rekabsaz, Markus Schedl


Abstract
Recent controllable text generation (CTG) for sentiment control has largely focused on decoder-based large language models, making causal attention the dominant paradigm. While effective for fluent generation, these models still struggle to satisfy complex constraints and follow fine-grained sentiment signals specified by users. Existing sentiment-aware CTG methods typically simplify the problem by treating sentiment either as a coarse categorical label (e.g., positive or negative) or as a single fine-grained control signal applied to an entire document. Consequently, more challenging settings such as sentence-level sentiment control within long-form text remain underexplored. To address these limitations, we introduce SenseShift, an encoder-based framework for fine-grained sentence-level CTG. Unlike standard decoder architectures, SenseShift leverages bidirectional attention, quantized sentiment signals, and iterative mask infilling to generate local sentences conditioned on target sentiment intensity. Empirical evaluations on story and review generation demonstrate that SenseShift achieves stronger sentiment controllability while maintaining text quality and robustness to out-of-domain generation compared to larger decoder-based baselines.
Anthology ID:
2026.findings-emnlp.1046
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
22144–22163
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1046/
DOI:
Bibkey:
Cite (ACL):
Shahed Masoudian, Markus Frohmann, Emmanouil Karystinaios, Navid Rekabsaz, and Markus Schedl. 2026. SENSESHIFT: Continuous Sentiment-Controlled Text generation via Encoder-based Mask Infilling. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 22144–22163, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SENSESHIFT: Continuous Sentiment-Controlled Text generation via Encoder-based Mask Infilling (Masoudian et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1046.pdf