Youhua Li
Author directory2026
Latent Reward Steering: An Adaptive Inference-Time Framework that Implicitly Promotes Cognitive Behaviors in Reasoning LLMs
Jiakang Li | Guanyu Zhu | Can Jin | Chenxi Huang | Dexu Yu | Ronghao Chen | Yang Zhou | Hongwu Peng | Xuanqi Lan | Dimitris N. Metaxas | Youhua Li
Findings of the Association for Computational Linguistics: EMNLP 2026
Jiakang Li | Guanyu Zhu | Can Jin | Chenxi Huang | Dexu Yu | Ronghao Chen | Yang Zhou | Hongwu Peng | Xuanqi Lan | Dimitris N. Metaxas | Youhua Li
Findings of the Association for Computational Linguistics: EMNLP 2026
Strong reasoning depends not only on model knowledge but also on how effectively cognitive behaviors are deployed during generation. Existing methods often rely on explicit behavior-level control, making them insufficiently adaptive when failures and required corrections vary across reasoning states, tasks, and models. To this end, we propose Latent Reward Steering (LRS), an adaptive inference-time framework that promotes cognitive behaviors by optimizing the sparse-autoencoder (SAE) latent states that implicitly carry them. Rather than relying on predefined cognitive behaviors or steering directions derived from them, LRS trains a latent reward model on reasoning traces by final answer correctness to estimate the quality of intermediate latent states. During inference, reward gradients provide state-specific correction directions for fragile latent states, while a reward and confidence gate restricts intervention to states the reward signal flags as fragile. Experiments on multiple reasoning LLM backbones and benchmarks show that LRS consistently improves performance over various baselines, and post-hoc analyses further indicate that LRS implicitly promotes good cognitive behaviors that fix the original reasoning errors. Codes are available at: https://anonymous.4open.science/r/Latent-Reward-Steering-5B56.
2025
SOLAR: Serendipity Optimized Language Model Aligned for Recommendation
Zichen Yuan | Lifan Sun | Yucen Zhuang | Yue Wang | Xinyuan Song | Tianqi Xu | Siyuan Li | Junchen Fu | Youhua Li | Sirui Hong | Jiaqi Chen | Joemon M. Jose | Yongxin Ni
Findings of the Association for Computational Linguistics: EMNLP 2025
Zichen Yuan | Lifan Sun | Yucen Zhuang | Yue Wang | Xinyuan Song | Tianqi Xu | Siyuan Li | Junchen Fu | Youhua Li | Sirui Hong | Jiaqi Chen | Joemon M. Jose | Yongxin Ni
Findings of the Association for Computational Linguistics: EMNLP 2025
Recently, Large Language Models (LLMs) have shown strong potential in recommendation tasks due to their broad world knowledge and reasoning capabilities. However, applying them to serendipity-oriented recommendation remains challenging, mainly due to a domain gap of LLMs in modeling personalized user behavior and the scarcity of labeled serendipitous interactions. In this paper, we introduce SOLAR (Serendipity-Optimized Language model Aligned for Recommendation), a two-stage framework that addresses these challenges. To alleviate label scarcity, we adopt a weak supervision strategy: a sequential ID-based recommender generates candidate items, which are then reranked by an LLM acting as a preference judge to produce serendipity-aware pseudo-labels. To bridge the domain gap, we propose a domain-adaptive instruction tuning method (SUN) that aligns LLMs with recommendation tasks. Experiments on three real-world datasets show that SOLAR consistently improves both accuracy and serendipity over strong baselines, showing its effectiveness in enabling more diverse, user-centric recommendations. Code and dataset are released at https://github.com/SOLAR2025ARR/SOLAR.