Dingkang Yang
Author directory2026
SpatialGuard: Harness-Guided Verifiable Spatial Reasoning for Text-to-Image Generation
Ziyun Qian | Zizhi Chen | Yizhou Liu | Mingyang Sun | Dingkang Yang | Lihua Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Ziyun Qian | Zizhi Chen | Yizhou Liu | Mingyang Sun | Dingkang Yang | Lihua Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Complex 3D spatial text to image generation requires models to convert natural language into stable visual geometry, not merely semantic appearance. Existing prompt-driven or layout-conditioned methods improve controllability, but often lack an optimizable and verifiable spatial intermediary before visual sampling. As a result, object relations, occlusion, visibility, and camera constraints can decay during multi-round generation. This paper presents SpatialGuard, a structured layout-guided framework for complex 3D spatial text-to-image generation. SpatialGuard parses prompts into image synthesis-oriented 3D layouts through a Spatial Layout Architect, realizes them as visual conditions and candidate images through a Visual Realizer, and uses a Visual Alignment Critic to validate consistency among prompt, layout, and image. To keep constraints stable across iterations, SpatialGuard introduces a Layout Harness that organizes rule constraints, tool invocation, shared knowledge, and feedback loops around the editable layout state. This design turns complex spatial generation from implicit prompt following into a verifiable process of planning, realization, validation, and repair. Comprehensive experiments show that SpatialGuard achieves state-of-the-art performance in complex 3D spatial layout generation and improves spatial faithfulness over existing text-to-image and layout control baselines.
Stephanie2: Thinking, Waiting, and Making Decisions Like Humans in Step-by-Step AI Social Chat
Hao Yang | Hongyuan Lu | Dingkang Yang | Wenliang Yang | Peng Sun | Wei Zuo | Xiaochuan Zhang | Jun Xiao | Kefan He | Wai Lam | Yang Liu | Xinhua Zeng
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Hao Yang | Hongyuan Lu | Dingkang Yang | Wenliang Yang | Peng Sun | Wei Zuo | Xiaochuan Zhang | Jun Xiao | Kefan He | Wai Lam | Yang Liu | Xinhua Zeng
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Instant-messaging human social chat typically progresses through a sequence of short messages. Existing step-by-step AI chatting systems typically split a one-shot generation into multiple messages and send them sequentially, but they lack an active waiting mechanism and exhibit unnatural message pacing. In order to address these issues, we propose Stephanie2, a new step-wise decision-making dialogue agent. With active waiting and message-pace adaptation, Stephanie2 explicitly decides at each step whether to send or wait, and models latency as the sum of thinking time and typing time to achieve more natural pacing. We further introduce a dual-agent dialogue system to generate pseudo dialogue histories for human and automatic evaluations. Experiments show that Stephanie2 clearly outperforms Stephanie1 on metrics such as naturalness and engagement, and achieves a higher pass rate on human evaluation with the role identification test.
MMEmb-R1: Reasoning-Enhanced Multimodal Embedding with Pair-Aware Selection and Adaptive Control
Yuchi Wang | Dingkang Yang | Haiyang Yu | Weikang Bian | Jiefeng Long | Liang Xiao | Chao Feng | Hongsheng Li
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yuchi Wang | Dingkang Yang | Haiyang Yu | Weikang Bian | Jiefeng Long | Liang Xiao | Chao Feng | Hongsheng Li
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
MLLMs have been successfully applied to multimodal embedding tasks, yet their generative reasoning capabilities remain underutilized. Directly incorporating chain-of-thought reasoning into embedding learning introduces two fundamental challenges. First, structural misalignment between instance-level reasoning and pairwise contrastive supervision may lead to shortcut behavior, where the model merely learns the superficial format of reasoning. Second, reasoning is not universally beneficial for embedding tasks. Enforcing reasoning for all inputs may introduce unnecessary computation and latency, and can even obscure salient semantic signals for simple cases. To address these issues, we propose MMEmb-R1, an adaptive reasoning-based multimodal embedding framework. We formulate reasoning as a latent variable and introduce pair-aware reasoning selection to identify reasoning paths beneficial for query-target alignment. Furthermore, we adopt reinforcement learning to selectively invoke reasoning only when necessary. Experiments on the MMEB-V2 benchmark demonstrate that our model achieves a score of 71.2 with only 4B parameters, establishing a new state-of-the-art while significantly reducing reasoning overhead and inference latency.
Can MLLMs Perceive and Describe Medical Image Quality Beyond Scores?
Jiyao Liu | Jinjie Wei | Wanying Qu | Chenglong Ma | Junzhi Ning | Yunheng Li | Ying Chen | Jiafan Zhang | Pengcheng Chen | Xin Gao | Ming Hu | Xin Wang | Shujian Gao | Dingkang Yang | Zhongying Deng | Jin Ye | Lihao Liu | Junjun He | Ningsheng Xu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Jiyao Liu | Jinjie Wei | Wanying Qu | Chenglong Ma | Junzhi Ning | Yunheng Li | Ying Chen | Jiafan Zhang | Pengcheng Chen | Xin Gao | Ming Hu | Xin Wang | Shujian Gao | Dingkang Yang | Zhongying Deng | Jin Ye | Lihao Liu | Junjun He | Ningsheng Xu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Medical Image Quality Assessment (IQA) serves as a critical safety gate for clinical AI, yet existing approaches rely on scalar metrics that fail to capture the descriptive, expert-like evaluation process central to clinical practice. We introduce MedQ-Bench, a comprehensive benchmark for language-based medical IQA evaluation with MLLMs, establishing a perception–description paradigm across 5 imaging modalities and over 40 quality attributes. The benchmark comprises two complementary tasks: MedQ-Perception probes low-level visual attribute discrimination via 2,600 expert-annotated perceptual queries; MedQ-Description covers both no-reference and comparison description sub-tasks with 708 expert-annotated samples, evaluated through a four-dimensional judging protocol. Comprehensive evaluation of 23 state-of-the-art MLLMs reveals that current models exhibit only preliminary and unstable capabilities, and highlights the urgent need for targeted optimization of MLLMs in medical IQA. Project Dataset: https://github.com/liujiyaoFDU/MedQ-Bench
2025
Boosting Multi-modal Keyphrase Prediction with Dynamic Chain-of-Thought in Vision-Language Models
Qihang Ma | Shengyu Li | Jie Tang | Dingkang Yang | Shaodong Chen | Yingyi Zhang | Chao Feng | Jiao Ran
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Qihang Ma | Shengyu Li | Jie Tang | Dingkang Yang | Shaodong Chen | Yingyi Zhang | Chao Feng | Jiao Ran
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Multi-modal keyphrase prediction (MMKP) aims to advance beyond text-only methods by incorporating multiple modalities of input information to produce a set of conclusive phrases. Traditional multi-modal approaches have been proven to have significant limitations in handling the challenging absence and unseen scenarios. Additionally, we identify shortcomings in existing benchmarks that overestimate model capability due to significant overlap in training tests. In this work, we propose leveraging vision-language models (VLMs) for the MMKP task. Firstly, we use two widely-used strategies, e.g., zero-shot and supervised fine-tuning (SFT) to assess the lower bound performance of VLMs. Next, to improve the complex reasoning capabilities of VLMs, we adopt Fine-tune-CoT, which leverages high-quality CoT reasoning data generated by a teacher model to finetune smaller models. Finally, to address the “overthinking” phenomenon, we propose a dynamic CoT strategy which adaptively injects CoT data during training, allowing the model to flexibly leverage its reasoning capabilities during the inference stage. We evaluate the proposed strategies on various datasets and the experimental results demonstrate the effectiveness of the proposed approaches. The code is available at https://github.com/bytedance/DynamicCoT.
Search
Fix author
Co-authors
- Chao Feng 2
- Weikang Bian 1
- Pengcheng Chen 1
- Shaodong Chen 1
- Ying Chen 1
- Zizhi Chen 1
- Zhongying Deng 1
- Shujian Gao 1
- Xin Gao 1
- Junjun He 1
- Kefan He 1
- Ming Hu 1
- Wai Lam 1
- Hongsheng Li 1
- Shengyu Li 1
- Yunheng Li 1
- Jiyao Liu 1
- Lihao Liu 1
- Yang Liu 1
- Yizhou Liu 1
- Jiefeng Long 1
- Hongyuan Lu 1
- Chenglong Ma 1
- Qihang Ma 1
- Junzhi Ning 1
- Ziyun Qian 1
- Wanying Qu 1
- Jiao Ran 1
- Mingyang Sun 1
- Peng Sun 1
- Jie Tang 1
- Xin Wang 1
- Yuchi Wang 1
- Jinjie Wei 1
- Jun Xiao 1
- Liang Xiao 1
- Ningsheng Xu 1
- Hao Yang 1
- Wenliang Yang 1
- Jin Ye 1
- Haiyang Yu 1
- Xinhua Zeng 1
- Jiafan Zhang 1
- Lihua Zhang 1
- Xiaochuan Zhang 1
- Yingyi Zhang 1
- Wei Zuo 1