Hongzhu Shi
Author directory2026
Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluation
Niantong Li | Guangzheng Hu | Weixu Qiao | Ying Ba | Qichen Hong | Shijun Shen | Jinlin Wang | Fan Zhou | Jianye Kang | Xin Shang | Ziyi HE | Wei Wang | Dalin Li | Jiahao Li | Jie Zhang | Kaiyuan Gao | Kun Yan | Lihan Jiang | Ningyuan Tang | Shengming Yin | Tianhe Wu | Xiao Xu | Xiaoyue Chen | Yuxiang Chen | Yan Shu | Yanran Zhang | Yilei Chen | Yixian Xu | Zekai Zhang | Zhendong Wang | Zihao Liu | Zikai Zhou | Hongzhu Shi | Yi Wang | Bing Zhao | hu Wei | Lin Qu | Chenfei Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Niantong Li | Guangzheng Hu | Weixu Qiao | Ying Ba | Qichen Hong | Shijun Shen | Jinlin Wang | Fan Zhou | Jianye Kang | Xin Shang | Ziyi HE | Wei Wang | Dalin Li | Jiahao Li | Jie Zhang | Kaiyuan Gao | Kun Yan | Lihan Jiang | Ningyuan Tang | Shengming Yin | Tianhe Wu | Xiao Xu | Xiaoyue Chen | Yuxiang Chen | Yan Shu | Yanran Zhang | Yilei Chen | Yixian Xu | Zekai Zhang | Zhendong Wang | Zihao Liu | Zikai Zhou | Hongzhu Shi | Yi Wang | Bing Zhao | hu Wei | Lin Qu | Chenfei Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Existing Text-to-Image (T2I) benchmarks remain anchored in foundational criteria such as image quality and text-image alignment, failing to capture the nuanced capabilities that professional creators demand in real-world workflows. Meanwhile, evaluation pipelines that rely on an untrained multimodal model as a judge diverge from human standards. We introduce Qwen-Image-Bench, a creator-centric benchmark that extends evaluation with two application-driven dimensions (Real-world Fidelity and Creative Generation), alongside the conventional pillars of Quality, Aesthetics, and Alignment. The benchmark organizes these into a three-level taxonomy (5 pillars, 23 sub-capabilities, 56 verifiable rubrics) and provides 1000 stratified bilingual prompts. We train a unified Judge Model (Q-Judger) on Qwen3.6-27B, supervised by 80 professional annotators under blind labeling and triple-review protocols, that scores every image across all 56 facets with fine-grained, rubric-grounded diagnostics. Empirically, Qwen-Image-Bench reliably distinguishes leading T2I models, achieving the greatest separation on the application-driven dimensions where existing benchmarks provide limited insight.
2023
ModelScope-Agent: Building Your Customizable Agent System with Open-source Large Language Models
Chenliang Li | He Chen | Ming Yan | Weizhou Shen | Haiyang Xu | Zhikai Wu | Zhicheng Zhang | Wenmeng Zhou | Yingda Chen | Chen Cheng | Hongzhu Shi | Ji Zhang | Fei Huang | Jingren Zhou
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Chenliang Li | He Chen | Ming Yan | Weizhou Shen | Haiyang Xu | Zhikai Wu | Zhicheng Zhang | Wenmeng Zhou | Yingda Chen | Chen Cheng | Hongzhu Shi | Ji Zhang | Fei Huang | Jingren Zhou
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Large language models (LLMs) have recently demonstrated remarkable capabilities to comprehend human intentions, engage in reasoning, and design planning-like behavior. To further unleash the power of LLMs to accomplish complex tasks, there is a growing trend to build agent frameworks that equips LLMs, such as ChatGPT, with tool-use abilities to connect with massive external APIs. In this work, we introduce ModelScope-Agent, a general and customizable agent framework for real-world applications, based on open-source LLMs as controllers. It provides a user-friendly system library, with a customizable engine design to support model training on multiple open-source LLMs, while also enabling seamless integration with both model APIs and common APIs in a unified way. To equip the LLMs with tool-use abilities, a comprehensive framework has been proposed spanning tool-use data collection, tool retrieval, tool registration, memory control, customized model training, and evaluation for practical real-world applications. Finally, we showcase ModelScopeGPT, a real-world intelligent assistant of ModelScope Community based on the ModelScope-Agent framework, which is able to connect open-source LLMs with more than 1000 public AI models and localized community knowledge in ModelScope. The ModelScope-Agent online demo, library are now publicly available.
Search
Fix author
Co-authors
- Ying Ba 1
- He Chen 1
- Xiaoyue Chen 1
- Yilei Chen 1
- Yingda Chen 1
- Yuxiang Chen 1
- Chen Cheng 1
- Kaiyuan Gao 1
- Ziyi HE 1
- Qichen Hong 1
- Guangzheng Hu 1
- Fei Huang 1
- Lihan Jiang 1
- Jianye Kang 1
- Chenliang Li 1
- Dalin Li 1
- Jiahao Li 1
- Niantong Li 1
- Zihao Liu 1
- Weixu Qiao 1
- Lin Qu 1
- Xin Shang 1
- Shijun Shen 1
- Weizhou Shen 1
- Yan Shu 1
- Ningyuan Tang 1
- Jinlin Wang 1
- Wei Wang 1
- Yi Wang 1
- Zhendong Wang 1
- hu Wei 1
- Chenfei Wu 1
- Tianhe Wu 1
- Zhikai Wu 1
- Haiyang Xu 1
- Xiao Xu 1
- Yixian Xu 1
- Kun Yan 1
- Ming Yan 1
- Shengming Yin 1
- Ji Zhang 1
- Jie Zhang 1
- Yanran Zhang 1
- Zekai Zhang 1
- Zhicheng Zhang 1
- Bing Zhao 1
- Fan Zhou 1
- Jingren Zhou 1
- Wenmeng Zhou 1
- Zikai Zhou 1