Tianyu Zhang
Author directoryPapers on this page may belong to the following people: Tianyu Zhang, Tianyu Zhang, Tianyu Zhang, Tianyu Zhang
2026
Chronological Thinking in Full-Duplex Spoken Dialogue Language Models
Donghang Wu | Haoyang Zhang | Chen Chen | Tianyu Zhang | Fei Tian | Xuerui Yang | Gang Yu | Hexin Liu | Nana Hou | Yuchen Hu | Eng Siong Chng
Proceedings of the 27th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Donghang Wu | Haoyang Zhang | Chen Chen | Tianyu Zhang | Fei Tian | Xuerui Yang | Gang Yu | Hexin Liu | Nana Hou | Yuchen Hu | Eng Siong Chng
Proceedings of the 27th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Recent advances in spoken dialogue language models (SDLMs) reflect growing interest in shifting from turn-based to full-duplex systems, where the models continuously perceive user speech streams while generating responses. This simultaneous listening and speaking design enables real-time interaction and the agent can handle dynamic conversational behaviors like user barge-in. However, during the listening phase, existing systems keep the agent idle by repeatedly predicting the silence token, which departs from human behavior: we usually engage in lightweight thinking during conversation rather than remaining absent-minded. Inspired by this, we propose Chronological Thinking, an on-the-fly conversational thinking mechanism that aims to improve response quality in full-duplex SDLMs. Specifically, chronological thinking presents a paradigm shift from conventional LLM thinking approaches, such as Chain-of-Thought, purpose-built for streaming acoustic input. (1) Strictly causal: the agent reasons incrementally while listening, updating internal hypotheses only from past audio with no lookahead. (2) No additional latency: reasoning is amortized during the listening window; once the user stops speaking, the agent halts thinking and begins speaking without further delay. Experiments demonstrate the effectiveness of chronological thinking through both objective metrics and human evaluations show consistent improvements in response quality. Furthermore, chronological thinking robustly handles conversational dynamics and attains competitive performance on full-duplex interaction metrics.
When 2D Tasks Meet 1D Serialization: On Serialization Friction in Structured Tasks
Chung-Hsiang Lo | Lu Li | Diji Yang | Tianyu Zhang | Yunkai Zhang | Yoshua Bengio | Yi Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Chung-Hsiang Lo | Lu Li | Diji Yang | Tianyu Zhang | Yunkai Zhang | Yoshua Bengio | Yi Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
In the LLM era, many symbolic and structured problems are presented to models through 1D text serialization. Yet some such problems are natively two-dimensional: their relevant relations, such as row–column correspondence or spatial adjacency, are defined by position in a 2D layout rather than by sequential order. This raises a representational question: does preserving the same symbolic entries in a 1D sequence also preserve the relational structure needed for computation? We study this issue through the lens of serialization friction: the representational mismatch in which the same underlying task instances and entries are still present, but relations that depend on layout become implicit under 1D serialization. The study uses a controlled synthetic testbed of three tasks: matrix transpose, Conway’s Game of Life, and LU decomposition. In each task, the same instances are presented either as 1D text serialization or as their native 2D layout rendered as an image. Across this testbed, 1D serialization degrades more sharply as task size grows, and errors under serialization exhibit spatially structured patterns, suggesting that this presentation choice is consequential within our testbed. To assess whether the gap is merely due to routing inputs through a visual pathway, we add a within-visual probe that renders the 1D serialized content as an image; this layout-disrupted rendering performs worse than native 2D rendering. These findings suggest that, for layout-defined tasks, reducing inputs to 1D serialization is not a neutral choice of representation.
2025
STRICT: Stress-Test of Rendering Image Containing Text
Tianyu Zhang | Xinyu Wang | Lu Li | Zhenghan Tai | Jijun Chi | Jingrui Tian | Hailin He | Suyuchen Wang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Tianyu Zhang | Xinyu Wang | Lu Li | Zhenghan Tai | Jijun Chi | Jingrui Tian | Hailin He | Suyuchen Wang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
While diffusion models have revolutionized text-to-image generation with their ability to synthesize realistic and diverse scenes, they continue to struggle with generating consistent and legible text within images. This shortcoming is commonly attributed to the locality bias inherent in diffusion-based generation, which limits their capacity to model long-range spatial dependencies. In this paper, we introduce STRICT, a benchmark designed to systematically stress-test the ability of diffusion models to render coherent and instruction-aligned text in images. Our benchmark evaluates models across multiple dimensions: (1) the maximum length of readable text that can be generated and (2) the correctness and legibility of the generated text. We assess several state-of-the-art models, including proprietary and open-source variants, and reveal persistent limitations in long-range consistency and instruction-following capabilities. Our findings provide insights into architectural bottlenecks and motivate future research directions in multimodal generative modeling.
2021
Search
Fix author
Co-authors
- Lu Li 2
- Yoshua Bengio 1
- Aaron Chan 1
- Chen Chen 1
- Jijun Chi 1
- Eng Siong Chng 1
- Hailin He 1
- Nana Hou 1
- Yuchen Hu 1
- Sungchul Kim 1
- Nedim Lipka 1
- Hexin Liu 1
- Chung-Hsiang Lo 1
- Mrigank Raman 1
- Xiang Ren 1
- Ryan Rossi 1
- Zhenghan Tai 1
- Fei Tian 1
- Jingrui Tian 1
- Suyuchen Wang 1
- Xinyu Wang 1
- Donghang Wu 1
- Jun Yan 1
- Diji Yang 1
- Xuerui Yang 1
- Gang Yu 1
- Haoyang Zhang 1
- Yi Zhang 1
- Yunkai Zhang 1
- Handong Zhao 1