Weixu Qiao
Author directory2026
Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluation
Niantong Li | Guangzheng Hu | Weixu Qiao | Ying Ba | Qichen Hong | Shijun Shen | Jinlin Wang | Fan Zhou | Jianye Kang | Xin Shang | Ziyi HE | Wei Wang | Dalin Li | Jiahao Li | Jie Zhang | Kaiyuan Gao | Kun Yan | Lihan Jiang | Ningyuan Tang | Shengming Yin | Tianhe Wu | Xiao Xu | Xiaoyue Chen | Yuxiang Chen | Yan Shu | Yanran Zhang | Yilei Chen | Yixian Xu | Zekai Zhang | Zhendong Wang | Zihao Liu | Zikai Zhou | Hongzhu Shi | Yi Wang | Bing Zhao | hu Wei | Lin Qu | Chenfei Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Niantong Li | Guangzheng Hu | Weixu Qiao | Ying Ba | Qichen Hong | Shijun Shen | Jinlin Wang | Fan Zhou | Jianye Kang | Xin Shang | Ziyi HE | Wei Wang | Dalin Li | Jiahao Li | Jie Zhang | Kaiyuan Gao | Kun Yan | Lihan Jiang | Ningyuan Tang | Shengming Yin | Tianhe Wu | Xiao Xu | Xiaoyue Chen | Yuxiang Chen | Yan Shu | Yanran Zhang | Yilei Chen | Yixian Xu | Zekai Zhang | Zhendong Wang | Zihao Liu | Zikai Zhou | Hongzhu Shi | Yi Wang | Bing Zhao | hu Wei | Lin Qu | Chenfei Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Existing Text-to-Image (T2I) benchmarks remain anchored in foundational criteria such as image quality and text-image alignment, failing to capture the nuanced capabilities that professional creators demand in real-world workflows. Meanwhile, evaluation pipelines that rely on an untrained multimodal model as a judge diverge from human standards. We introduce Qwen-Image-Bench, a creator-centric benchmark that extends evaluation with two application-driven dimensions (Real-world Fidelity and Creative Generation), alongside the conventional pillars of Quality, Aesthetics, and Alignment. The benchmark organizes these into a three-level taxonomy (5 pillars, 23 sub-capabilities, 56 verifiable rubrics) and provides 1000 stratified bilingual prompts. We train a unified Judge Model (Q-Judger) on Qwen3.6-27B, supervised by 80 professional annotators under blind labeling and triple-review protocols, that scores every image across all 56 facets with fine-grained, rubric-grounded diagnostics. Empirically, Qwen-Image-Bench reliably distinguishes leading T2I models, achieving the greatest separation on the application-driven dimensions where existing benchmarks provide limited insight.
RubricRM: Generative Reward Modeling via Dynamic Rubrics for Image Generation and Editing
Zijian Kan | Wei Wang | Luo Long | Bing Zhao | Xuan Ren | Weixu Qiao | Li Wenbo | hu Wei | Lin Qu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zijian Kan | Wei Wang | Luo Long | Bing Zhao | Xuan Ren | Weixu Qiao | Li Wenbo | hu Wei | Lin Qu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Reward models play an essential role in aligning visual generative models, yet most existing visual reward models use a single scalar score or rely on fixed criteria that cannot adapt to different instructions. This limits both interpretability and task sensitivity, especially for text-to-image generation and instruction-based image editing, where different inputs require different evaluation dimensions. We propose RubricRM, a pairwise generative reward modeling framework that first produces an input-specific rubric with evaluation dimensions, weights, and scoring criteria, and then applies the rubric to score candidate images. We train dedicated RubricRM models for text-to-image generation and image editing using a two-stage training pipeline: supervised fine-tuning teaches the model the rubric-based scoring paradigm, while GRPO further improves scoring through fine-grained dimension-level rewards. Experiments on multiple generation and editing benchmarks show that RubricRM outperforms existing specialized reward models and remains competitive with strong proprietary MLLM judges despite using smaller backbones. Our models, data, and code are available at https://github.com/zijiankan/RubricRM.
Search
Fix author
Co-authors
- Lin Qu 2
- Wei Wang 2
- hu Wei 2
- Bing Zhao 2
- Ying Ba 1
- Xiaoyue Chen 1
- Yilei Chen 1
- Yuxiang Chen 1
- Kaiyuan Gao 1
- Ziyi HE 1
- Qichen Hong 1
- Guangzheng Hu 1
- Lihan Jiang 1
- Zijian Kan 1
- Jianye Kang 1
- Dalin Li 1
- Jiahao Li 1
- Niantong Li 1
- Zihao Liu 1
- Luo Long 1
- Xuan Ren 1
- Xin Shang 1
- Shijun Shen 1
- Hongzhu Shi 1
- Yan Shu 1
- Ningyuan Tang 1
- Jinlin Wang 1
- Yi Wang 1
- Zhendong Wang 1
- Li Wenbo 1
- Chenfei Wu 1
- Tianhe Wu 1
- Xiao Xu 1
- Yixian Xu 1
- Kun Yan 1
- Shengming Yin 1
- Jie Zhang 1
- Yanran Zhang 1
- Zekai Zhang 1
- Fan Zhou 1
- Zikai Zhou 1