Jianzhi Shao
Author directory2026
How Do Answer Tokens Read Reasoning Traces? Self-Reading Patterns in Thinking LLMs for Quantitative Reasoning
Haoyang Chen | Yi Liu | Jianzhi Shao | Tao Zhang | Chengfu Huo | Wei Hu
Findings of the Association for Computational Linguistics: ACL 2026
Haoyang Chen | Yi Liu | Jianzhi Shao | Tao Zhang | Chengfu Huo | Wei Hu
Findings of the Association for Computational Linguistics: ACL 2026
Thinking LLMs produce reasoning traces before answering. Prior activation steering work mainly targets on shaping these traces. It remains less understood how answer tokens actually read and integrate the reasoning to produce reliable outcomes. Focusing on quantitative reasoning, we analyze the answer-to-reasoning attention and observe a benign self-reading pattern aligned with correctness, characterized by a forward drift of the reading focus along the reasoning trace and a persistent concentration on key semantic anchors, whereas incorrect solutions exhibit diffuse and irregular attention pattern. We interpret this as internal certainty during answer decoding, where the model commits to a viable solution branch and integrates key evidence. Following this, we propose a training-free steering method driven by Self-Reading Quality (SRQ) scores combining geometric metrics for process control with semantic metrics for content monitoring. SRQ selects data to build steering vectors that guide inference toward benign self-reading and away from uncertain and disorganized reading. Experiments show that our method yields consistent accuracy gains.
Polished but Unresolved: Identifying Late-Stage Pressure States in Long-Horizon Tool-Use Agents
Haoyang Chen | Yi Liu | Jianzhi Shao | Xiaozhou Xu | Zhe Sun | Wei Hu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Haoyang Chen | Yi Liu | Jianzhi Shao | Xiaozhou Xu | Zhe Sun | Wei Hu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Long-horizon tool-use agents need not only to search and plan, but also to decide when to finalize. We study late-stage pressure states, in which an agent is biased toward submitting a final answer that appears complete and polished while key constraints remain unresolved. We first train a linear probe to show that this pressure state is identifiable from the agent’s hidden states. Then, we use activation interventions along this pressure direction and find that shifting the hidden states changes both the pressure score and whether the agent continues tool use or submits early. Through controlled context manipulations, we further see that the pressure is mitigated by constraint clarity and action mapping. Based on these findings, we propose Probe-Sensed Pressure Relief (PSPR), a plugin that applies lightweight pressure relief direction under moderate pressure and moves to structured organization under high pressure risk. Experiments on multiple long-horizon benchmarks show that our method consistently strengthens existing agent methods.
Beyond Query-Item Matching: Personalized Behavioral Relevance Modeling for E-commerce Search via Rubric-Guided Reinforcement Learning
Yang Liu | Chenxu Wang | Jianzhi Shao | Jun Ji | Xiaozhou Xu | Zhe Sun | Wei Hu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Yang Liu | Chenxu Wang | Jianzhi Shao | Jun Ji | Xiaozhou Xu | Zhe Sun | Wei Hu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
E-commerce search systems typically separate query-item relevance matching from downstream personalized ranking. While effective for large-scale serving, this design leaves relevance levels dominated by objective query-item matching, forcing follow-up ranking to operate over candidate structures that may not reflect user behavioral preference. We define a new personalized behavioral relevance task, which predicts whether a relevance-stage candidate item is supported by the user’s behavioral evidence under current query intent. We develop a corresponding framework, BRIDGE, for Behavioral Relevance Inference with Dynamic Guidance from Evidence. It organizes multi-timescale behavioral context from online logs, obtains reliable supervision with multi-perspective annotation and adjudication, and trains an LLM to produce structured evidence-grounded decision rationales. It particularly incorporates sample-specific rubric rewards into GRPO to improve generated reasoning traces. Offline experiments validate that BRIDGE improves both prediction accuracy and reasoning quality. Online A/B tests show gains of 0.19% in active user-days and 0.67% in transaction-related user-days, both significant in statistics.
2020
Dialogue Distillation: Open-Domain Dialogue Augmentation Using Unpaired Data
Rongsheng Zhang | Yinhe Zheng | Jianzhi Shao | Xiaoxi Mao | Yadong Xi | Minlie Huang
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Rongsheng Zhang | Yinhe Zheng | Jianzhi Shao | Xiaoxi Mao | Yadong Xi | Minlie Huang
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Recent advances in open-domain dialogue systems rely on the success of neural models that are trained on large-scale data. However, collecting large-scale dialogue data is usually time-consuming and labor-intensive. To address this data dilemma, we propose a novel data augmentation method for training open-domain dialogue models by utilizing unpaired data. Specifically, a data-level distillation process is first proposed to construct augmented dialogues where both post and response are retrieved from the unpaired data. A ranking module is employed to filter out low-quality dialogues. Further, a model-level distillation process is employed to distill a teacher model trained on high-quality paired data to augmented dialogue pairs, thereby preventing dialogue models from being affected by the noise in the augmented data. Automatic and manual evaluation indicates that our method can produce high-quality dialogue pairs with diverse contents, and the proposed data-level and model-level dialogue distillation can improve the performance of competitive baselines.