Extended Inductive Reasoning for Personalized Preference Inference from Behavioral Signals

Jia-Nan Li, Jian Guan, Wei Wu, Rui Yan


Abstract
While large language models (LLMs) excel at deductive reasoning tasks such as math and coding, their capacity for inductive reasoning remains underexplored. This paper investigates this through the lens of personalized preference inference, where models must synthesize consistent patterns from implicit behavioral signals in users’ interaction histories. We propose AlignXplore, a model that leverages extended reasoning chains to enable explicit preference inference. Such explicit articulation enables an efficient streaming inference mechanism, allowing the model to incrementally refine preference descriptions without reprocessing historical signals. Guided by a specialized reward modeling strategy, we develop AlignXplore by combining synthetic-data cold-start training with online reinforcement learning. Extensive experiments show AlignXplore outperforms the backbone model by 15.49% on average across in- and out-of-domain benchmarks, while exhibiting robust generalization to diverse input formats and downstream models. Our analysis further establishes reward modeling best practices and reveals the emergence of human-like inductive reasoning patterns during training.
Anthology ID:
2026.emnlp-main.718
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
16650–16682
Language:
URL:
https://aclanthology.org/2026.emnlp-main.718/
DOI:
Bibkey:
Cite (ACL):
Jia-Nan Li, Jian Guan, Wei Wu, and Rui Yan. 2026. Extended Inductive Reasoning for Personalized Preference Inference from Behavioral Signals. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 16650–16682, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Extended Inductive Reasoning for Personalized Preference Inference from Behavioral Signals (Li et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.718.pdf