Kun Yan
Author directory2026
Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluation
Niantong Li | Guangzheng Hu | Weixu Qiao | Ying Ba | Qichen Hong | Shijun Shen | Jinlin Wang | Fan Zhou | Jianye Kang | Xin Shang | Ziyi HE | Wei Wang | Dalin Li | Jiahao Li | Jie Zhang | Kaiyuan Gao | Kun Yan | Lihan Jiang | Ningyuan Tang | Shengming Yin | Tianhe Wu | Xiao Xu | Xiaoyue Chen | Yuxiang Chen | Yan Shu | Yanran Zhang | Yilei Chen | Yixian Xu | Zekai Zhang | Zhendong Wang | Zihao Liu | Zikai Zhou | Hongzhu Shi | Yi Wang | Bing Zhao | hu Wei | Lin Qu | Chenfei Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Niantong Li | Guangzheng Hu | Weixu Qiao | Ying Ba | Qichen Hong | Shijun Shen | Jinlin Wang | Fan Zhou | Jianye Kang | Xin Shang | Ziyi HE | Wei Wang | Dalin Li | Jiahao Li | Jie Zhang | Kaiyuan Gao | Kun Yan | Lihan Jiang | Ningyuan Tang | Shengming Yin | Tianhe Wu | Xiao Xu | Xiaoyue Chen | Yuxiang Chen | Yan Shu | Yanran Zhang | Yilei Chen | Yixian Xu | Zekai Zhang | Zhendong Wang | Zihao Liu | Zikai Zhou | Hongzhu Shi | Yi Wang | Bing Zhao | hu Wei | Lin Qu | Chenfei Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Existing Text-to-Image (T2I) benchmarks remain anchored in foundational criteria such as image quality and text-image alignment, failing to capture the nuanced capabilities that professional creators demand in real-world workflows. Meanwhile, evaluation pipelines that rely on an untrained multimodal model as a judge diverge from human standards. We introduce Qwen-Image-Bench, a creator-centric benchmark that extends evaluation with two application-driven dimensions (Real-world Fidelity and Creative Generation), alongside the conventional pillars of Quality, Aesthetics, and Alignment. The benchmark organizes these into a three-level taxonomy (5 pillars, 23 sub-capabilities, 56 verifiable rubrics) and provides 1000 stratified bilingual prompts. We train a unified Judge Model (Q-Judger) on Qwen3.6-27B, supervised by 80 professional annotators under blind labeling and triple-review protocols, that scores every image across all 56 facets with fine-grained, rubric-grounded diagnostics. Empirically, Qwen-Image-Bench reliably distinguishes leading T2I models, achieving the greatest separation on the application-driven dimensions where existing benchmarks provide limited insight.
Qwen-Image-Layered 1.5: Unified Image Generation and Editing with Native Transparency Awareness
Shengming Yin | Zekai Zhang | Yixian Xu | Kaiyuan Gao | Zhendong Wang | Lihan Jiang | Ningyuan Tang | Tianhe Wu | Xiaoyue Chen | Yanran Zhang | Zihao Liu | Zikai Zhou | Jiahao Li | Xiao Xu | Kun Yan | Yuxiang Chen | Yilei Chen | Yan Shu | Jie Zhang | Heung-Yeung Shum | Lionel Ni | Jingren Zhou | Chenfei Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Shengming Yin | Zekai Zhang | Yixian Xu | Kaiyuan Gao | Zhendong Wang | Lihan Jiang | Ningyuan Tang | Tianhe Wu | Xiaoyue Chen | Yanran Zhang | Zihao Liu | Zikai Zhou | Jiahao Li | Xiao Xu | Kun Yan | Yuxiang Chen | Yilei Chen | Yan Shu | Jie Zhang | Heung-Yeung Shum | Lionel Ni | Jingren Zhou | Chenfei Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Recent advances in image generation and editing have been driven by powerful pretrained unified models, yet most existing approaches remain fundamentally raster-centric: they represent images as opaque pixels without natively modeling transparency. This limitation restricts their applicability to a broad range of real-world applications. In this work, we present Qwen-Image-Layered 1.5, a pretrained unified image generation and editing model with native transparency awareness. By jointly modeling visual appearance and transparency, our framework supports a wide range of both raster-centric and transparency-aware tasks within a single model. Notably, we observe that the model can perform transparent image editing in a zero-shot manner. To systematically evaluate this new task, we introduce TransEdit-Bench, the first benchmark specifically designed for transparent image editing. Extensive experiments across various tasks demonstrate strong performance and highlight the great potential of transparency-native image modeling as a unified paradigm for future image synthesis and editing.
2023
KU-DMIS-MSRA at RadSum23: Pre-trained Vision-Language Model for Radiology Report Summarization
Gangwoo Kim | Hajung Kim | Lei Ji | Seongsu Bae | Chanhwi Kim | Mujeen Sung | Hyunjae Kim | Kun Yan | Eric Chang | Jaewoo Kang
Proceedings of the 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks
Gangwoo Kim | Hajung Kim | Lei Ji | Seongsu Bae | Chanhwi Kim | Mujeen Sung | Hyunjae Kim | Kun Yan | Eric Chang | Jaewoo Kang
Proceedings of the 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks
In this paper, we introduce CheXOFA, a new pre-trained vision-language model (VLM) for the chest X-ray domain. Our model is initially pre-trained on various multimodal datasets within the general domain before being transferred to the chest X-ray domain. Following a prominent VLM, we unify various domain-specific tasks into a simple sequence-to-sequence schema. It enables the model to effectively learn the required knowledge and skills from limited resources in the domain. Demonstrating superior performance on the benchmark datasets provided by the BioNLP shared task (Delbrouck et al., 2023), our model benefits from its training across multiple tasks and domains. With subtle techniques including ensemble and factual calibration, our system achieves first place on the RadSum23 leaderboard for the hidden test set.
CONE: An Efficient COarse-to-fiNE Alignment Framework for Long Video Temporal Grounding
Zhijian Hou | Wanjun Zhong | Lei Ji | Difei Gao | Kun Yan | W.K. Chan | Chong-Wah Ngo | Mike Zheng Shou | Nan Duan
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zhijian Hou | Wanjun Zhong | Lei Ji | Difei Gao | Kun Yan | W.K. Chan | Chong-Wah Ngo | Mike Zheng Shou | Nan Duan
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
This paper tackles an emerging and challenging problem of long video temporal grounding (VTG) that localizes video moments related to a natural language (NL) query. Compared with short videos, long videos are also highly demanded but less explored, which brings new challenges in higher inference computation cost and weaker multi-modal alignment. To address these challenges, we propose CONE, an efficient COarse-to-fiNE alignment framework. CONE is a plug-and-play framework on top of existing VTG models to handle long videos through a sliding window mechanism. Specifically, CONE (1) introduces a query-guided window selection strategy to speed up inference, and (2) proposes a coarse-to-fine mechanism via a novel incorporation of contrastive learning to enhance multi-modal alignment for long videos. Extensive experiments on two large-scale long VTG benchmarks consistently show both substantial performance gains (e.g., from 3.13 to 6.87% on MAD) and state-of-the-art results. Analyses also reveal higher efficiency as the query-guided window selection mechanism accelerates inference time by 2x on Ego4D-NLQ and 15x on MAD while keeping SOTA results. Codes have been released at https://github.com/houzhijian/CONE.
2021
Control Image Captioning Spatially and Temporally
Kun Yan | Lei Ji | Huaishao Luo | Ming Zhou | Nan Duan | Shuai Ma
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Kun Yan | Lei Ji | Huaishao Luo | Ming Zhou | Nan Duan | Shuai Ma
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Generating image captions with user intention is an emerging need. The recently published Localized Narratives dataset takes mouse traces as another input to the image captioning task, which is an intuitive and efficient way for a user to control what to describe in the image. However, how to effectively employ traces to improve generation quality and controllability is still under exploration. This paper aims to solve this problem by proposing a novel model called LoopCAG, which connects Contrastive constraints and Attention Guidance in a Loop manner, engaged explicit spatial and temporal constraints to the generating process. Precisely, each generated sentence is temporally aligned to the corresponding trace sequence through a contrastive learning strategy. Besides, each generated text token is supervised to attend to the correct visual objects under heuristic spatial attention guidance. Comprehensive experimental results demonstrate that our LoopCAG model learns better correspondence among the three modalities (vision, language, and traces) and achieves SOTA performance on trace-controlled image captioning task. Moreover, the controllability and explainability of LoopCAG are validated by analyzing spatial and temporal sensitivity during the generation process.
Search
Fix author
Co-authors
- Lei Ji 3
- Xiaoyue Chen 2
- Yilei Chen 2
- Yuxiang Chen 2
- Nan Duan 2
- Kaiyuan Gao 2
- Lihan Jiang 2
- Jiahao Li 2
- Zihao Liu 2
- Yan Shu 2
- Ningyuan Tang 2
- Zhendong Wang 2
- Chenfei Wu 2
- Tianhe Wu 2
- Xiao Xu 2
- Yixian Xu 2
- Shengming Yin 2
- Jie Zhang 2
- Yanran Zhang 2
- Zekai Zhang 2
- Zikai Zhou 2
- Ying Ba 1
- Seongsu Bae 1
- W.K. Chan 1
- Eric Chang 1
- Difei Gao 1
- Ziyi HE 1
- Qichen Hong 1
- Zhijian Hou 1
- Guangzheng Hu 1
- Jaewoo Kang 1
- Jianye Kang 1
- Chanhwi Kim 1
- Gangwoo Kim 1
- Hajung Kim 1
- Hyunjae Kim 1
- Dalin Li 1
- Niantong Li 1
- Huaishao Luo 1
- Shuai Ma 1
- Chong-Wah Ngo 1
- Lionel Ni 1
- Weixu Qiao 1
- Lin Qu 1
- Xin Shang 1
- Shijun Shen 1
- Hongzhu Shi 1
- Mike Zheng Shou 1
- Heung Yeung Shum 1
- Mujeen Sung 1
- Jinlin Wang 1
- Wei Wang 1
- Yi Wang 1
- hu Wei 1
- Bing Zhao 1
- Wanjun Zhong 1
- Fan Zhou 1
- Jingren Zhou 1
- Ming Zhou 1