Wei-Bin Kou
Author directory2026
Latent Dreaming: Let Language Think Yet Latent See in Driving VLA
Zhixuan You | Ruixu Zhang | Junjie Wang | Yuxin Meng | Lisheng Wu | Lei Zhou | Wei-Bin Kou | Yujiu Yang
Findings of the Association for Computational Linguistics: EMNLP 2026
Zhixuan You | Ruixu Zhang | Junjie Wang | Yuxin Meng | Lisheng Wu | Lei Zhou | Wei-Bin Kou | Yujiu Yang
Findings of the Association for Computational Linguistics: EMNLP 2026
Vision-language-action (VLA) models for autonomous driving typically express intermediate reasoning entirely in text, which may discard decision-relevant visual information. We propose Latent Dreaming (LatDM), a latent–text reasoning framework that complements textual chain-of-thought with continuous latent states. LatDM uses latent blocks to preserve visually grounded spatial and temporal information, while text handles semantic abstraction and decision communication. A pretrained visual encoder provides latent supervision during training, and the model autonomously interleaves latent and textual reasoning at inference. Experiments on VLADBench, CODA-LM, and NuInstruct show consistent improvements over the underlying VLA backbone, while ablations confirm that the latent channel contributes beyond standard textual fine-tuning.
Integrated and Cross-Architecture Interpretation of LLM Reasoning
Leonardo Matthew Yauw | Wei-Bin Kou | Yujiu Yang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Leonardo Matthew Yauw | Wei-Bin Kou | Yujiu Yang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Understanding how LLMs reason is hindered by a practical asymmetry: while their generated outputs are observable, the underlying reasoning patterns remain opaque. Relying on single probes, such as Mutual Information Peak (MIP) or Deep-Thinking Ratio (DTR), risks underestimating the genuine inferential structure. To response this deficiency, we present an Integrated, cross-Architecture Reasoning (IAR) framework, designed to provide a unified approach to LLM reasoning interpretability. Specifically, we first propose to use bandwidth-calibrated MIP coupled with Tukey IQR peak-detection to isolate reasoning-crucial tokens at the output layer. Second, we performed an overlap analysis between MIP-picked tokens and DTR-deep tokens to trace the cross-layer trajectories of those tokens. This also discloses whether reasoning-crucial tokens are computation-intensive as well, further facilitating to understand how reasoning patterns evolve across model layers. Finally, we apply a Jaccard stability metric over multi-domain problems to verify if the MIP-identified tokens are reasoning quality-guaranteed. Extensive experiments on six models across four domains (mathematics, code, logic, and common sense) demonstrate IAR’s generalizable interpretation capabilities across architectures. Our code is available at https://github.com/LeonardoMatthew/IAR.