Ya-Qi Yu
Author directory2026
UniCAR-RL: Seeing Better before Thinking Deeper in Visual Mathematics
Yuzhe Li | Hao Yan | Hao Wang | Xingchen Liu | Ya-Qi Yu | Jihao Wu | Minghui Liao | Wei Chen | Yuliang Liu
Findings of the Association for Computational Linguistics: EMNLP 2026
Yuzhe Li | Hao Yan | Hao Wang | Xingchen Liu | Ya-Qi Yu | Jihao Wu | Minghui Liao | Wei Chen | Yuliang Liu
Findings of the Association for Computational Linguistics: EMNLP 2026
Multimodal Large Language Models (MLLMs) often struggle with complex mathematical visual reasoning primarily due to a lack of fine-grained perception, causing initial visual hallucinations to directly trigger cascading reasoning failures. In traditional end-to-end reinforcement learning (RL), sparse rewards fail to decouple perceptual hallucinations from logical missteps, hindering targeted perception optimization. Alternatively, fine-tuning with perception-enhanced CoT data incurs high costs and hallucinations. In this paper, we address these challenges by proposing UniCAR-RL, an annotation-free RL framework. By explicitly decoupling the optimization of perception and reasoning during the training process, it achieves isolation and optimization of both capabilities. Specifically, UniCAR-RL consists of three synergistic branches: 1) a Caption-RL branch that optimizes perception capabilities through verifier-guided reasoning validation; 2) a Reasoning-RL branch that performs logical reasoning based on a gold image description to halt cascading errors; 3) a QA-RL branch that retains native end-to-end alignment to ensure robust question-answering performance. Experiments show that UniCAR-RL substantially improves MLLMs’ mathematical and visual reasoning using only raw short-answer data. Furthermore, it demonstrates strong generalization across diverse architectures and scales.
Reinforcement Learning with Robust Rubric Rewards
Ya-Qi Yu | Hao Wang | Fangyu Hong | Xiangyang Qu | Gaojie Wu | Qiaoyu Luo | Nuo Xu | Huixin Wang | Wuheng Xu | Yongxin Liao | Zihao Chen | Haonan Li | Ziming Li | Dezhi Peng | Minghui Liao | Jihao Wu | Haoyu Ren | Dandan Tu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Ya-Qi Yu | Hao Wang | Fangyu Hong | Xiangyang Qu | Gaojie Wu | Qiaoyu Luo | Nuo Xu | Huixin Wang | Wuheng Xu | Yongxin Liao | Zihao Chen | Haonan Li | Ziming Li | Dezhi Peng | Minghui Liao | Jihao Wu | Haoyu Ren | Dandan Tu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
While RLVR is effective for deterministically verifiable tasks, many vision-language tasks are only *partially verifiable*, demanding multi-criterion supervision. To bridge this gap, we propose *Reinforcement Learning with Robust Rubric Rewards (RLR3), extending RL with criterion-level rewards. To ensure faithful scoring, RLR3 routes each criterion to one of two execution paths: an LLM-as-an-extractor paired with a verifier, or an LLM-as-a-Judge for fuzzy criteria. We also introduce a minimal exposure strategy that masks verifier targets from extractors and source images from the GenRM. Furthermore, RLR3 employs decoupled normalization to mitigate score saturation and hierarchical aggregation to prioritize essential criteria. Evaluated on Qwen3-VL-30B-A3B across 15 benchmarks, RLR3 consistently outperforms RLVR, yielding a 4.7-point improvement over the base model and exceeding the official instruct-to-thinking model gap. Controlled audits show that deterministic verifier and minimal exposure strategy reduce exploitable false positives.
Visual Preference Optimization with Rubric Rewards
Ya-Qi Yu | Fangyu Hong | Xiangyang Qu | Hao Wang | Gaojie Wu | Qiaoyu Luo | Nuo Xu | Huixin Wang | Wuheng Xu | Yongxin Liao | Zihao Chen | Haonan Li | Ziming Li | Dezhi Peng | Minghui Liao | Jihao Wu | Haoyu Ren | Dandan Tu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Ya-Qi Yu | Fangyu Hong | Xiangyang Qu | Hao Wang | Gaojie Wu | Qiaoyu Luo | Nuo Xu | Huixin Wang | Wuheng Xu | Yongxin Liao | Zihao Chen | Haonan Li | Ziming Li | Dezhi Peng | Minghui Liao | Jihao Wu | Haoyu Ren | Dandan Tu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
The effectiveness of Direct Preference Optimization (DPO) depends on data pairs that capture task-relevant quality differences. Existing data pipelines often rely on *off-policy* perturbations or *coarse* outcome-based signals, which are not well suited to fine-grained visual reasoning. We propose *rDPO*, a rubric-based data pipeline for DPO-based visual preference optimization. For each image-instruction pair, we create a checklist-style rubric of essential and additional criteria to score responses from any possible policies. The instruction-rubric pool is built *offline* and reused during the construction of *on-policy* preference data. On public reward modeling benchmarks, rubric-based prompting massively improves a 30B-A3B judge and brings it close to GPT-5.4. On public downstream benchmarks, rubric-based filtering raises the macro average to 82.69, whereas outcome-based filtering drops it to 75.82 from 81.14. In scalability evaluation on a comprehensive benchmark, rDPO achieves 61.01, markedly outperforming the style-constrained baseline (52.36) and surpassing the 59.48 base model. Together, these results show that visual preference optimization benefits from combining on-policy data construction with instance-specific criterion-level feedback.
2025
UI-Hawk: Unleashing the Screen Stream Understanding for Mobile GUI Agents
Jiwen Zhang | Ya-Qi Yu | Minghui Liao | WenTao Li | Jihao Wu | Zhongyu Wei
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Jiwen Zhang | Ya-Qi Yu | Minghui Liao | WenTao Li | Jihao Wu | Zhongyu Wei
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Graphical User Interface (GUI) agents are expected to precisely operate on the screens of digital devices. Existing GUI agents merely depend on current visual observations and plain-text action history, ignoring the significance of history screens. To mitigate this issue, we propose UI-Hawk, a multi-modal GUI agent specially designed to process screen streams encountered during GUI navigation. UI-Hawk incorporates a history-aware visual encoder to handle the screen sequences. To acquire a better understanding of screen streams, we select four fundamental tasks—UI grounding, UI referring, screen question answering, and screen summarization. We further propose a curriculum learning strategy to subsequently guide the model from fundamental tasks to advanced screen-stream comprehension.Along with the efforts above, we have also created a benchmark FunUI to quantitatively evaluate the fundamental screen understanding ability of MLLMs. Extensive experiments on FunUI and GUI navigation benchmarks consistently validate that screen stream understanding is essential for GUI tasks.Our code and data are now available at https://github.com/IMNearth/UIHawk.