Chenfei Wu
Author directory2026
Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluation
Niantong Li | Guangzheng Hu | Weixu Qiao | Ying Ba | Qichen Hong | Shijun Shen | Jinlin Wang | Fan Zhou | Jianye Kang | Xin Shang | Ziyi HE | Wei Wang | Dalin Li | Jiahao Li | Jie Zhang | Kaiyuan Gao | Kun Yan | Lihan Jiang | Ningyuan Tang | Shengming Yin | Tianhe Wu | Xiao Xu | Xiaoyue Chen | Yuxiang Chen | Yan Shu | Yanran Zhang | Yilei Chen | Yixian Xu | Zekai Zhang | Zhendong Wang | Zihao Liu | Zikai Zhou | Hongzhu Shi | Yi Wang | Bing Zhao | hu Wei | Lin Qu | Chenfei Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Niantong Li | Guangzheng Hu | Weixu Qiao | Ying Ba | Qichen Hong | Shijun Shen | Jinlin Wang | Fan Zhou | Jianye Kang | Xin Shang | Ziyi HE | Wei Wang | Dalin Li | Jiahao Li | Jie Zhang | Kaiyuan Gao | Kun Yan | Lihan Jiang | Ningyuan Tang | Shengming Yin | Tianhe Wu | Xiao Xu | Xiaoyue Chen | Yuxiang Chen | Yan Shu | Yanran Zhang | Yilei Chen | Yixian Xu | Zekai Zhang | Zhendong Wang | Zihao Liu | Zikai Zhou | Hongzhu Shi | Yi Wang | Bing Zhao | hu Wei | Lin Qu | Chenfei Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Existing Text-to-Image (T2I) benchmarks remain anchored in foundational criteria such as image quality and text-image alignment, failing to capture the nuanced capabilities that professional creators demand in real-world workflows. Meanwhile, evaluation pipelines that rely on an untrained multimodal model as a judge diverge from human standards. We introduce Qwen-Image-Bench, a creator-centric benchmark that extends evaluation with two application-driven dimensions (Real-world Fidelity and Creative Generation), alongside the conventional pillars of Quality, Aesthetics, and Alignment. The benchmark organizes these into a three-level taxonomy (5 pillars, 23 sub-capabilities, 56 verifiable rubrics) and provides 1000 stratified bilingual prompts. We train a unified Judge Model (Q-Judger) on Qwen3.6-27B, supervised by 80 professional annotators under blind labeling and triple-review protocols, that scores every image across all 56 facets with fine-grained, rubric-grounded diagnostics. Empirically, Qwen-Image-Bench reliably distinguishes leading T2I models, achieving the greatest separation on the application-driven dimensions where existing benchmarks provide limited insight.
Qwen-Image-Layered 1.5: Unified Image Generation and Editing with Native Transparency Awareness
Shengming Yin | Zekai Zhang | Yixian Xu | Kaiyuan Gao | Zhendong Wang | Lihan Jiang | Ningyuan Tang | Tianhe Wu | Xiaoyue Chen | Yanran Zhang | Zihao Liu | Zikai Zhou | Jiahao Li | Xiao Xu | Kun Yan | Yuxiang Chen | Yilei Chen | Yan Shu | Jie Zhang | Heung-Yeung Shum | Lionel Ni | Jingren Zhou | Chenfei Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Shengming Yin | Zekai Zhang | Yixian Xu | Kaiyuan Gao | Zhendong Wang | Lihan Jiang | Ningyuan Tang | Tianhe Wu | Xiaoyue Chen | Yanran Zhang | Zihao Liu | Zikai Zhou | Jiahao Li | Xiao Xu | Kun Yan | Yuxiang Chen | Yilei Chen | Yan Shu | Jie Zhang | Heung-Yeung Shum | Lionel Ni | Jingren Zhou | Chenfei Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Recent advances in image generation and editing have been driven by powerful pretrained unified models, yet most existing approaches remain fundamentally raster-centric: they represent images as opaque pixels without natively modeling transparency. This limitation restricts their applicability to a broad range of real-world applications. In this work, we present Qwen-Image-Layered 1.5, a pretrained unified image generation and editing model with native transparency awareness. By jointly modeling visual appearance and transparency, our framework supports a wide range of both raster-centric and transparency-aware tasks within a single model. Notably, we observe that the model can perform transparent image editing in a zero-shot manner. To systematically evaluate this new task, we introduce TransEdit-Bench, the first benchmark specifically designed for transparent image editing. Extensive experiments across various tasks demonstrate strong performance and highlight the great potential of transparency-native image modeling as a unified paradigm for future image synthesis and editing.
2024
Low-code LLM: Graphical User Interface over Large Language Models
Yuzhe Cai | Shaoguang Mao | Wenshan Wu | Zehua Wang | Yaobo Liang | Tao Ge | Chenfei Wu | Wang You | Ting Song | Yan Xia | Nan Duan | Furu Wei
Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 3: System Demonstrations)
Yuzhe Cai | Shaoguang Mao | Wenshan Wu | Zehua Wang | Yaobo Liang | Tao Ge | Chenfei Wu | Wang You | Ting Song | Yan Xia | Nan Duan | Furu Wei
Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 3: System Demonstrations)
Utilizing Large Language Models (LLMs) for complex tasks is challenging, often involving a time-consuming and uncontrollable prompt engineering process. This paper introduces a novel human-LLM interaction framework, Low-code LLM. It incorporates six types of simple low-code visual programming interactions to achieve more controllable and stable responses. Through visual interaction with a graphical user interface, users can incorporate their ideas into the process without writing trivial prompts. The proposed Low-code LLM framework consists of a Planning LLM that designs a structured planning workflow for complex tasks, which can be correspondingly edited and confirmed by users through low-code visual programming operations, and an Executing LLM that generates responses following the user-confirmed workflow. We highlight three advantages of the low-code LLM: user-friendly interaction, controllable generation, and wide applicability. We demonstrate its benefits using four typical applications. By introducing this framework, we aim to bridge the gap between humans and LLMs, enabling more effective and efficient utilization of LLMs for complex tasks. The code, prompts, and experimental details are available at https://github.com/moymix/TaskMatrix/tree/main/LowCodeLLM. A system demonstration video can be found at https://www.youtube.com/watch?v=jb2C1vaeO3E.
Learning to Plan by Updating Natural Language
Yiduo Guo | Yaobo Liang | Chenfei Wu | Wenshan Wu | Dongyan Zhao | Nan Duan
Findings of the Association for Computational Linguistics: EMNLP 2024
Yiduo Guo | Yaobo Liang | Chenfei Wu | Wenshan Wu | Dongyan Zhao | Nan Duan
Findings of the Association for Computational Linguistics: EMNLP 2024
Large Language Models (LLMs) have shown remarkable performance in various basic natural language tasks. For completing the complex task, we still need a plan for the task to guide LLMs to generate the specific solutions step by step. LLMs can directly generate task plans, but these plans may still contain factual errors or are incomplete. A high-quality task plan contains correct step-by-step solutions for solving all situations and behavioral instructions for avoiding mistakes. To obtain it, we propose the Learning to Plan method, which involves two phases: (1) In the first learning task plan phase, it iteratively updates the task plan with new step-by-step solutions and behavioral instructions, which are obtained by prompting LLMs to derive from training error feedback. (2) In the subsequent test phase, the LLM uses the learned task plan to guide the inference of LLM on the test set. We demonstrate the effectiveness of our method on the five different reasoning type tasks (8 datasets). Further, our analysis experiment shows that the task plan learned by one LLM can directly guide another LLM to improve its performance, which reveals a new transfer learning paradigm.
2023
ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning
Xiao Xu | Bei Li | Chenfei Wu | Shao-Yen Tseng | Anahita Bhiwandiwalla | Shachar Rosenman | Vasudev Lal | Wanxiang Che | Nan Duan
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Xiao Xu | Bei Li | Chenfei Wu | Shao-Yen Tseng | Anahita Bhiwandiwalla | Shachar Rosenman | Vasudev Lal | Wanxiang Che | Nan Duan
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Two-Tower Vision-Language (VL) models have shown promising improvements on various downstream VL tasks. Although the most advanced work improves performance by building bridges between encoders, it suffers from ineffective layer-by-layer utilization of uni-modal representations and cannot flexibly exploit different levels of uni-modal semantic knowledge. In this work, we propose ManagerTower, a novel VL model architecture that gathers and combines the insights of pre-trained uni-modal experts at different levels. The managers introduced in each cross-modal layer can adaptively aggregate uni-modal semantic knowledge to facilitate more comprehensive cross-modal alignment and fusion. ManagerTower outperforms previous strong baselines both with and without Vision-Language Pre-training (VLP). With only 4M VLP data, ManagerTower achieves superior performances on various downstream VL tasks, especially 79.15% accuracy on VQAv2 Test-Std, 86.56% IR@1 and 95.64% TR@1 on Flickr30K. Code and checkpoints are available at https://github.com/LooperXX/ManagerTower.
NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation
Shengming Yin | Chenfei Wu | Huan Yang | Jianfeng Wang | Xiaodong Wang | Minheng Ni | Zhengyuan Yang | Linjie Li | Shuguang Liu | Fan Yang | Jianlong Fu | Ming Gong | Lijuan Wang | Zicheng Liu | Houqiang Li | Nan Duan
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Shengming Yin | Chenfei Wu | Huan Yang | Jianfeng Wang | Xiaodong Wang | Minheng Ni | Zhengyuan Yang | Linjie Li | Shuguang Liu | Fan Yang | Jianlong Fu | Ming Gong | Lijuan Wang | Zicheng Liu | Houqiang Li | Nan Duan
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
In this paper, we propose NUWA-XL, a novel Diffusion over Diffusion architecture for eXtremely Long video generation. Most current work generates long videos segment by segment sequentially, which normally leads to the gap between training on short videos and inferring long videos, and the sequential generation is inefficient. Instead, our approach adopts a “coarse-to-fine” process, in which the video can be generated in parallel at the same granularity. A global diffusion model is applied to generate the keyframes across the entire time range, and then local diffusion models recursively fill in the content between nearby frames. This simple yet effective strategy allows us to directly train on long videos (3376 frames) to reduce the training-inference gap and makes it possible to generate all segments in parallel. To evaluate our model, we build FlintstonesHD dataset, a new benchmark for long video generation. Experiments show that our model not only generates high-quality long videos with both global and local coherence, but also decreases the average inference time from 7.55min to 26s (by 94.26%) at the same hardware setting when generating 1024 frames. The homepage link is [NUWA-XL](https://msra-nuwa.azurewebsites.net)
2022
KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation
Yongfei Liu | Chenfei Wu | Shao-Yen Tseng | Vasudev Lal | Xuming He | Nan Duan
Findings of the Association for Computational Linguistics: NAACL 2022
Yongfei Liu | Chenfei Wu | Shao-Yen Tseng | Vasudev Lal | Xuming He | Nan Duan
Findings of the Association for Computational Linguistics: NAACL 2022
Self-supervised vision-and-language pretraining (VLP) aims to learn transferable multi-modal representations from large-scale image-text data and to achieve strong performances on a broad scope of vision-language tasks after finetuning. Previous mainstream VLP approaches typically adopt a two-step strategy relying on external object detectors to encode images in a multi-modal Transformer framework, which suffer from restrictive object concept space, limited image context and inefficient computation. In this paper, we propose an object-aware end-to-end VLP framework, which directly feeds image grid features from CNNs into the Transformer and learns the multi-modal representations jointly. More importantly, we propose to perform object knowledge distillation to facilitate learning cross-modal alignment at different semantic levels. To achieve that, we design two novel pretext tasks by taking object features and their semantic labels from external detectors as supervision: 1.) Object-guided masked vision modeling task focuses on enforcing object-aware representation learning in the multi-modal Transformer; 2.) Phrase-region alignment task aims to improve cross-modal alignment by utilizing the similarities between noun phrases and object labels in the linguistic space. Extensive experiments on a wide range of vision-language tasks demonstrate the efficacy of our proposed framework, and we achieve competitive or superior performances over the existing pretraining strategies.
2021
Search
Fix author
Co-authors
- Nan Duan 6
- Xiao Xu 3
- Shengming Yin 3
- Xiaoyue Chen 2
- Yilei Chen 2
- Yuxiang Chen 2
- Kaiyuan Gao 2
- Lihan Jiang 2
- Vasudev Lal 2
- Jiahao Li 2
- Yaobo Liang 2
- Yongfei Liu 2
- Zihao Liu 2
- Yan Shu 2
- Ningyuan Tang 2
- Shao-Yen Tseng 2
- Zhendong Wang 2
- Tianhe Wu 2
- Wenshan Wu 2
- Yixian Xu 2
- Kun Yan 2
- Jie Zhang 2
- Yanran Zhang 2
- Zekai Zhang 2
- Zikai Zhou 2
- Ying Ba 1
- Taroon Bharti 1
- Anahita Bhiwandiwalla 1
- Yuzhe Cai 1
- Wanxiang Che (车万翔) 1
- Edward Cui 1
- Jianlong Fu 1
- Tao Ge 1
- Ming Gong 1
- Yiduo Guo 1
- Ziyi HE 1
- Xuming He 1
- Qichen Hong 1
- Guangzheng Hu 1
- Lei Ji 1
- Jianye Kang 1
- Bei Li 1
- Dalin Li 1
- Houqiang Li 1
- Linjie Li 1
- Niantong Li 1
- Shuguang Liu 1
- Zicheng Liu 1
- Huaishao Luo 1
- Shaoguang Mao 1
- Lionel Ni 1
- Minheng Ni 1
- Weixu Qiao 1
- Lin Qu 1
- Shachar Rosenman 1
- Arun Sacheti 1
- Xin Shang 1
- Shijun Shen 1
- Hongzhu Shi 1
- Heung Yeung Shum 1
- Ting Song 1
- Lin Su 1
- Jianfeng Wang 1
- Jinlin Wang 1
- Lijuan Wang 1
- Wei Wang 1
- Xiaodong Wang 1
- Yi Wang 1
- Zehua Wang 1
- Furu Wei 1
- hu Wei 1
- Yan Xia 1
- Fan Yang 1
- Huan Yang 1
- Zhengyuan Yang 1
- Wang You 1
- Bing Zhao 1
- Dongyan Zhao 1
- Ming Zhong 1
- Fan Zhou 1
- Jingren Zhou 1