MoF: Preference-Aware Mixture Modeling for Black-Box LLM Personalization

Hun Park


Abstract
Proprietary Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks, yet aligning their outputs with diverse user preferences remains challenging. Existing personalization approaches for black-box LLMs often rely on user-specific scoring heads, causing the number of personalized parameters to grow linearly with the number of users and requiring additional adaptation for unseen users. To address these limitations, we propose Mixture-of-Facets (MoF), a scalable personalization framework for black-box LLMs that models user preferences as compositions of shared latent preference facets rather than dedicated user-specific parameters. MoF performs personalization through history-conditioned routing over shared facet heads, enabling personalization for users unseen during training without additional parameter updates. Across diverse personalization tasks, MoF delivers stronger personalization performance while maintaining a more scalable and parameter-efficient design than prior approaches. Additional analysis indicates strong generalization to unseen users.
Anthology ID:
2026.emnlp-main.533
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
12290–12309
Language:
URL:
https://aclanthology.org/2026.emnlp-main.533/
DOI:
Bibkey:
Cite (ACL):
Hun Park. 2026. MoF: Preference-Aware Mixture Modeling for Black-Box LLM Personalization. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 12290–12309, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
MoF: Preference-Aware Mixture Modeling for Black-Box LLM Personalization (Park, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.533.pdf