Text as a Universal Interface for Transferable Personalization

Yuting Liu, Jian Guan, Jia-Nan Li, Wei Wu, Jiang-Ming Yang, Jianzhe Zhao, Guibing Guo


Abstract
We study the problem of personalization in large language models (LLMs). Prior work predominantly represents user preferences as implicit, model-specific vectors or parameters, yielding opaque “black-box” profiles that are difficult to interpret and transfer across models and tasks. In contrast, we advocate natural language as a universal, model- and task-agnostic interface for preference representation. The formulation leads to interpretable and reusable preference descriptions, while naturally supporting continual evolution as new interactions are observed. To learn such representations, we introduce a two-stage training framework that combines supervised fine-tuning on high-quality synthesized data with reinforcement learning to optimize long-term utility and cross-task transferability. Based on this framework, we develop AlignXplore+, a universal preference reasoning model that generates textual preference summaries. Experiments on nine benchmarks show that our 8B model achieves state-of-the-art performance—outperforming substantially larger open-source models—while exhibiting strong transferability across tasks, model families, and interaction formats. Code and dataset are accessible at https://github.com/AntResearchNLP/AlignX-Family/tree/main/AlignXplorePlus.
Anthology ID:
2026.emnlp-main.695
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
15977–16018
Language:
URL:
https://aclanthology.org/2026.emnlp-main.695/
DOI:
Bibkey:
Cite (ACL):
Yuting Liu, Jian Guan, Jia-Nan Li, Wei Wu, Jiang-Ming Yang, Jianzhe Zhao, and Guibing Guo. 2026. Text as a Universal Interface for Transferable Personalization. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 15977–16018, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Text as a Universal Interface for Transferable Personalization (Liu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.695.pdf