Jiayu Yang
Author directoryOther people with similar names: Jiayu Yang
2026
Demystifying Hidden-State Recurrence: Switchable Latent Reasoning with On-Policy Reinforcement Learning
Jiayu Yang | Chao Chen | Shengen Wu | Yinhong Liu | Yuxuan Fan | Lujundong Li | Songning Lai | Chengwei Qin | Zhijiang Guo
Findings of the Association for Computational Linguistics: EMNLP 2026
Jiayu Yang | Chao Chen | Shengen Wu | Yinhong Liu | Yuxuan Fan | Lujundong Li | Songning Lai | Chengwei Qin | Zhijiang Guo
Findings of the Association for Computational Linguistics: EMNLP 2026
Latent chain-of-thought compresses reasoning by replacing visible reasoning traces with continuous hidden-state recurrence, but existing formulations are difficult to optimize with standard on-policy reinforcement learning (RL) and hard to interpret causally. Our key insight is that a single pair of explicit boundary tokens can address both issues at once: discrete entry and exit anchors make the latent block compatible with standard on-policy RL, and the same anchors offer a natural foothold for mechanistic analysis. Motivated by this, we propose SWITCH, a switchable latent reasoning framework. The model emits ‘<swi>‘ to enter latent mode and ‘</swi>‘ to exit. Because the boundaries are ordinary discrete tokens, the GRPO policy ratio is well-defined at every decision point. The same anchors also expose the latent steps to direct probing and causal intervention. We train the model with a visible-to-latent curriculum and a Switch-GRPO objective that propagates gradients through recurrent latent computation. SWITCH consistently outperforms prior hidden-state-recurrence latent reasoning approaches at similar scale. Mechanistic analysis through the boundary tokens further reveals three findings: (i) ‘<swi>‘ is a sharply localised, learned switching policy rather than a stylistic artefact; (ii) the latent step it opens performs problem-specific, causally important computation rather than acting as an inert placeholder; and (iii) that computation is concentrated at a single hidden-state transition on entry. Together, these results show that hidden-state-recurrence latent reasoning is both RL-trainable and open to direct mechanistic analysis, including of how on-policy RL itself improves the model from the inside.
Decomposing Visual Histories with Vision-Language Agents: Hierarchical Temporal Guidance for Compositional Image Generation
Lujundong Li | Mingxu Zhang | Songning Lai | Jiayu Yang | Yuxuan Fan | Ziwei Xie | Feng Liu | Changwang Zhang | Jun Wang | Dazhong Shen | Ying Sun
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Lujundong Li | Mingxu Zhang | Songning Lai | Jiayu Yang | Yuxuan Fan | Ziwei Xie | Feng Liu | Changwang Zhang | Jun Wang | Dazhong Shen | Ying Sun
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Reference-conditioned image generation increasingly relies on visual histories that rarely speak with one voice: one example pins the subject, another fixes a layout, a third only suggests a palette. Current image-conditioned diffusion methods encode these references once, average them into a single vector, and inject it at every denoising step, so conflicting cues collide and the output is faithful to none. We propose the Hierarchical Temporal Guidance Framework (HTGF), a training-free pipeline that reframes multi-reference conditioning as a *temporal routing* problem. A semantic decomposer reads each reference and emits a soft routing distribution over three axes (Subject, Structure, Detail), and a closed-form SNR-sensitivity argument places each axis in the denoising window where it has the most leverage. A short manifold-aware corrector then smooths the trajectory at the stage boundaries where the active condition changes. HTGF adds no training and no architectural change to the diffusion backbone. On three datasets it outperforms strong VLM- and diffusion-based baselines, gaining +11.7 CIS over LaVIT on Movie Poster and FID 38.87 vs. 50.12 for the best baseline under noisy histories, and degrading gracefully down to the zero-reference limit.