Jiaqi Gu
Author directory2026
DICS: Exploring Data Intrinsic Consistency for Visual Instruction Selection
Yuyang Hong | Jinhui Guo | Jiaqi Gu | Lubin Fan | Ruixiang Wang | Kun Ding | Yue Wu | Shiming Xiang | Jieping Ye
Findings of the Association for Computational Linguistics: EMNLP 2026
Yuyang Hong | Jinhui Guo | Jiaqi Gu | Lubin Fan | Ruixiang Wang | Kun Ding | Yue Wu | Shiming Xiang | Jieping Ye
Findings of the Association for Computational Linguistics: EMNLP 2026
Visual instruction tuning is crucial for advancing the vision-language alignment and instruction-following capabilities of Vision-Language Models (VLMs). However, identifying optimal subsets under a fixed ratio constraint from rapidly expanding datasets remains a significant bottleneck. While existing methods largely depend on distribution diversity or heuristic filtering, they often overlook the internal coherence within individual samples. To bridge this gap, we propose Data Intrinsic Consistency (DIC), a self-scoring metric designed to quantify the sample-level inter-component consistency. DIC consists of two modules: Visual Information Consistency (VIC), evaluating the alignment between visual content and instructions, and Response Information Consistency (RIC), assessing response coherence relative to the instruction. Building upon DIC, we introduce Data Intrinsic Consistency Selection (DICS), an adaptive data selection method that optimizes the trade-off between high intra-sample consistency and global distributional diversity under varying data budgets. Extensive experiments demonstrate that DICS consistently outperforms state-of-the-art methods across diverse dataset scales and model architectures, surpassing full-dataset fine-tuning while using only 25% of the LLaVA-1.5-665K data.
Towards a Mechanistic Understanding of Large Reasoning Models: A Survey of Training, Inference, and Failures
Yi Hu | Jiaqi Gu | Ruxin Wang | Zijun Yao | Hao Peng | Xiaobao Wu | Jianhui Chen | Muhan Zhang | Liangming Pan
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yi Hu | Jiaqi Gu | Ruxin Wang | Zijun Yao | Hao Peng | Xiaobao Wu | Jianhui Chen | Muhan Zhang | Liangming Pan
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Reinforcement learning (RL) has catalyzed the emergence of Large Reasoning Models (LRMs) that have pushed reasoning capabilities to new heights. While their performance has garnered significant excitement, exploring the internal mechanisms driving these behaviors has become an equally critical research frontier. This paper provides a comprehensive survey of the mechanistic understanding of LRMs, organizing recent findings into three core dimensions: 1) training dynamics, 2) reasoning mechanisms, and 3) unintended behaviors. By synthesizing these insights, we aim to bridge the gap between black-box performance and mechanistic transparency. Finally, we discuss under-explored challenges to outline a roadmap for future mechanistic studies, including the need for applied interpretability, improved methodologies, and a unified theoretical framework.