Xingyan Liu
Author directory2026
Adapting Technical-Service LLM Agents with Latent Logic Augmentation, Robust Noise Reduction, and Hybrid Reward Modeling
Junzhuo Ma | Chenghuang Shen | Yi Yu | Xingyan Liu | Jing Gu | Hangyi Sun | Guangquan Hu | Jianfeng Liu | Weiting Liu | Pu Mingyue | Wang Yu | Zhengdong Xiao | Rui Xie | Longjiu Luo | Qianrong Wang | Gurong Cui | Honglin Qiao | Wenlian Lu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Junzhuo Ma | Chenghuang Shen | Yi Yu | Xingyan Liu | Jing Gu | Hangyi Sun | Guangquan Hu | Jianfeng Liu | Weiting Liu | Pu Mingyue | Wang Yu | Zhengdong Xiao | Rui Xie | Longjiu Luo | Qianrong Wang | Gurong Cui | Honglin Qiao | Wenlian Lu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Technical-service LLM agents are entering production workflows, where value depends on whether engineers adopt generated replies. Service tickets hide decision logic, contain noisy single-reference responses, and make reward evaluation costly, making standard post-training brittle. Existing post-training and LLM-as-a-Judge approaches improve grounding or feedback, but do not jointly model latent decision logic, response diversity, and reward cost. We address this gap by coupling latent logic augmentation, robust noise reduction, and hybrid reward modeling. The framework augments supervised fine-tuning data with Planning-Aware Trajectory Modeling and Reasoning Augmentation, builds dual-filtered Multiple Ground Truths, and trains the policy with a hybrid reward that combines a Reranker with an LLM-as-a-Judge. On real Cloud technical-service tasks, the adapted Qwen3-4B achieves the highest Multi-ECS (0.441), lower reward cost, and the highest production adoption rate (46.63%).
2025
S2R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning
Ruotian Ma | Peisong Wang | Cheng Liu | Xingyan Liu | Jiaqi Chen | Bang Zhang | Xin Zhou | Nan Du | Jia Li
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Ruotian Ma | Peisong Wang | Cheng Liu | Xingyan Liu | Jiaqi Chen | Bang Zhang | Xin Zhou | Nan Du | Jia Li
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Recent studies have demonstrated the effectiveness of LLM test-time scaling. However, existing approaches to incentivize LLMs’ deep thinking abilities generally require large-scale data or significant training efforts. Meanwhile, it remains unclear how to improve the thinking abilities of less powerful base models. In this work, we introduce S2R, an efficient framework that enhances LLM reasoning by teaching models to self-verify and self-correct during inference. Specifically, we first initialize LLMs with iterative self-verification and self-correction behaviors through supervised fine-tuning on carefully curated data. The self-verification and self-correction skills are then further strengthened by outcome-level and process-level reinforcement learning with minimized resource requirements. Our results demonstrate that, with only 3.1k behavior initialization samples, Qwen2.5-math-7B achieves an accuracy improvement from 51.0% to 81.6%, outperforming models trained on an equivalent amount of long-CoT distilled data. We also discuss the effect of different RL strategies on enhancing LLMs’ deep reasoning. Extensive experiments and analysis based on three base models across both in-domain and out-of-domain benchmarks validate the effectiveness of S2R.