Qixiang Yin
Author directory2026
SGG-R 3: From Next-Token Prediction to End-to-End Unbiased Scene Graph Generation
Jiaye Feng | Qixiang Yin | Yuankun Liu | Tong Mo | Weiping Li
Findings of the Association for Computational Linguistics: ACL 2026
Jiaye Feng | Qixiang Yin | Yuankun Liu | Tong Mo | Weiping Li
Findings of the Association for Computational Linguistics: ACL 2026
Scene Graph Generation (SGG) structures visual scenes as graphs of objects and their relations. While Multimodal Large Language Models (MLLMs) have advanced end-to-end SGG, current methods are hindered by both a lack of task-specific structured reasoning and the challenges of sparse, long-tailed relation distributions, resulting in incomplete scene graphs characterized by low recall and biased predictions. To address these issues, we introduce SGG-R 3, a structured reasoning framework that integrates task-specific Chain-of-Thought (CoT)-guided supervised fine-tuning (SFT) and reinforcement learning (RL) with group sequence policy optimization (GSPO), designed to engage in three sequential stages to achieve end-to-end unbiased scene graph generation. During the SFT phase, we propose a relation augmentation strategy by leveraging an MLLM and refined via embedding similarity filtering to alleviate relation sparsity. Subsequently, a stage-aligned reward scheme optimizes the procedural reasoning during RL. Specifically, we propose a novel dual-granularity reward which integrates fine-grained and coarse-grained relation rewards, simultaneously mitigating the long-tail issue via frequency-based adaptive weighting of predicates and improving relation coverage through semantic clustering. Experiments on two benchmarks show that SGG-R 3 achieves superior performance compared to existing methods, demonstrating the effectiveness and generalization of the framework.
H-OPD: Confidence Aware Heterogeneous Multi-Teacher Multimodal On-Policy Distillation
Qixiang Yin | Huanjin Yao | Cai Yuchen | Jianghao Chen | Ziyi Wang | Min Yang | Fei Su | Zhicheng Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Qixiang Yin | Huanjin Yao | Cai Yuchen | Jianghao Chen | Ziyi Wang | Min Yang | Fei Su | Zhicheng Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
On-policy distillation (OPD) has recently emerged as an effective post-training paradigm by providing supervision on student-generated trajectories. However, existing OPD methods for multimodal reasoning usually rely on a static teacher routing, assigning each sample to a single teacher based on modality or task type. This ignores that visual grounding and abstract reasoning may dominate different decoding steps, making a single teacher insufficient for the full trajectory. To this end, H-OPD is proposed as a confidence-aware heterogeneous multi-teacher OPD framework for multimodal reasoning. By verifying the complementarity of heterogeneous teachers in the same reasoning process, H-OPD replaces task or sample level teacher routing with token-level teacher arbitration along the shared student trajectory. H-OPD employs vision-to-language description transfer to enable text-only teachers to access key visual semantics, and uses a confidence-aware arbitration mechanism to dynamically combine vision-language teacher and text-only teachers at each token. Extensive evaluations over 11 widely-used reasoning benchmarks showcase the superior performance of our method.