Qiankun Li
Author directoryOther people with similar names: Qiankun Li
2026
Diagnosing Knowledge Conflict in Multimodal Long-Chain Reasoning
Jing Tang | Kun Wang | Haolang Lu | Hongjin Chen | KaiTao Chen | Zhongxiang Sun | Qiankun Li | Lingjuan Lyu | Guoshun Nan | Zhigang Zeng
Findings of the Association for Computational Linguistics: EMNLP 2026
Jing Tang | Kun Wang | Haolang Lu | Hongjin Chen | KaiTao Chen | Zhongxiang Sun | Qiankun Li | Lingjuan Lyu | Guoshun Nan | Zhigang Zeng
Findings of the Association for Computational Linguistics: EMNLP 2026
Multimodal large language models in long chain-of-thought reasoning often fail when different knowledge sources provide conflicting signals. We formalize these failures under a unified notion of knowledge conflict, distinguishing input-level objective conflict from process-level effective conflict. Through probing internal representations, we reveal that: **(I) Linear Separability**: different conflict types are explicitly encoded as linearly separable features rather than entangled; **(II) Depth Localization**: conflict signals concentrate in mid-to-late layers, indicating a distinct processing stage for conflict encoding; **(III) Hierarchical Consistency**: aggregating noisy token-level signals along trajectories robustly recovers input-level conflict types; and **(IV) Directional Asymmetry**: reinforcing the model’s implicit source preference under conflict is far easier than enforcing the opposite source. Our findings provide a mechanism-level view of multimodal reasoning under knowledge conflict and enable principled diagnosis and control of long-CoT failures. Code is available at [anonymous link](https://anonymous.4open.science/r/Diagnosing-Knowledge-Conflict-C78D/).
Verification Trap: Understanding Test-Time Selection Failures under False Premises in Code Generation
Feng He | Hejia Wang | Linghao Meng | Ming Gao | Qiankun Li
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Feng He | Hejia Wang | Linghao Meng | Ming Gao | Qiankun Li
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Test-time compute has become a central way to improve code generation: systems sample multiple candidate programs and use verifier-visible evidence to select the final output. This paradigm implicitly assumes that the verifier provides a corrective signal independent from the generator. We challenge this assumption under misleading task premises. When the generator and verifier share a false premise, they become coupled through a mistaken belief: the generator produces premise-consistent shortcuts, while the verifier supplies evidence that fails to expose them. Consequently, the selector may choose a hidden-test-wrong candidate even when a hidden-test-correct program exists in the pool. We call this failure mode Verification Trap. Across three code-generation benchmarks and five code models, false premises consistently degrade first-sample correctness, reduce selector-chosen correctness after 64-sample test-time selection, and amplify recoverable mis-selection. Mechanistically, verifier-written tests inherit the premise-level blind spot, reshaping verifier-visible candidate space away from hidden-test correctness. These traces make Verification Trap predictable before hidden execution: a lightweight gold-free predictor using verifier-visible features reaches 0.846 AUROC. Our results identify decoupled evidence as a key mitigation axis: coupled scaling provides limited recovery, whereas premise-agnostic robustness auditors recover substantial oracle headroom.
SaFeR-Steer: Evolving Multi-Turn MLLMs via Synthetic Bootstrapping and Feedback Dynamics
Haolong Hu | Hanyu Li | Tiancheng He | Huahui Yi | An Zhang | Qiankun Li | Kun Wang | Yang Liu | Zhigang Zeng
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Haolong Hu | Hanyu Li | Tiancheng He | Huahui Yi | An Zhang | Qiankun Li | Kun Wang | Yang Liu | Zhigang Zeng
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
MLLMs are increasingly deployed in multi-turn settings, where attackers can escalate unsafe intent through the evolving visual-text history and exploit long-context safety decay. Yet safety alignment is still dominated by single-turn data and fixed-template dialogues, leaving a mismatch between training and deployment.
To bridge this gap, we propose SaFeR-Steer, a progressive multi-turn alignment framework that combines staged synthetic bootstrapping with tutor-in-the-loop GRPO to train a single student under adaptive, on-policy attacks. We also introduce Trajectory-Consistent Summative Reward (TCSR), which aggregates the historical minimum and average of turn rewards so that any low-quality turn affects the trajectory-level return.
I. Dataset. We release STEER, a multi-turn multimodal safety dataset with STEER-SFT (12,934), STEER-RL (2,000), and STEER-Bench (3,227) dialogues spanning 1–10 turns. II. Experiment. Starting from Qwen2.5-VL-3B/7B, SaFeR-Steer substantially improves Safety/Helpfulness on both single-turn (48.30/45.86 → 81.84/70.77 for 3B; 56.21/60.32 → 87.89/77.40 for 7B) and multi-turn benchmarks (12.55/27.13 → 55.58/70.27 for 3B; 24.66/46.48 → 64.89/72.35 for 7B), shifting failures to later turns and yielding robustness beyond scaling alone.
Code is available at https://github.com/Ed-Bg/SaFeR-Steer-full
To bridge this gap, we propose SaFeR-Steer, a progressive multi-turn alignment framework that combines staged synthetic bootstrapping with tutor-in-the-loop GRPO to train a single student under adaptive, on-policy attacks. We also introduce Trajectory-Consistent Summative Reward (TCSR), which aggregates the historical minimum and average of turn rewards so that any low-quality turn affects the trajectory-level return.
I. Dataset. We release STEER, a multi-turn multimodal safety dataset with STEER-SFT (12,934), STEER-RL (2,000), and STEER-Bench (3,227) dialogues spanning 1–10 turns. II. Experiment. Starting from Qwen2.5-VL-3B/7B, SaFeR-Steer substantially improves Safety/Helpfulness on both single-turn (48.30/45.86 → 81.84/70.77 for 3B; 56.21/60.32 → 87.89/77.40 for 7B) and multi-turn benchmarks (12.55/27.13 → 55.58/70.27 for 3B; 24.66/46.48 → 64.89/72.35 for 7B), shifting failures to later turns and yielding robustness beyond scaling alone.
Code is available at https://github.com/Ed-Bg/SaFeR-Steer-full