Heung Yeung Shum
Author directoryAlso published as: Heung-Yeung Shum
2026
Qwen-Image-Layered 1.5: Unified Image Generation and Editing with Native Transparency Awareness
Shengming Yin | Zekai Zhang | Yixian Xu | Kaiyuan Gao | Zhendong Wang | Lihan Jiang | Ningyuan Tang | Tianhe Wu | Xiaoyue Chen | Yanran Zhang | Zihao Liu | Zikai Zhou | Jiahao Li | Xiao Xu | Kun Yan | Yuxiang Chen | Yilei Chen | Yan Shu | Jie Zhang | Heung-Yeung Shum | Lionel Ni | Jingren Zhou | Chenfei Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Shengming Yin | Zekai Zhang | Yixian Xu | Kaiyuan Gao | Zhendong Wang | Lihan Jiang | Ningyuan Tang | Tianhe Wu | Xiaoyue Chen | Yanran Zhang | Zihao Liu | Zikai Zhou | Jiahao Li | Xiao Xu | Kun Yan | Yuxiang Chen | Yilei Chen | Yan Shu | Jie Zhang | Heung-Yeung Shum | Lionel Ni | Jingren Zhou | Chenfei Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Recent advances in image generation and editing have been driven by powerful pretrained unified models, yet most existing approaches remain fundamentally raster-centric: they represent images as opaque pixels without natively modeling transparency. This limitation restricts their applicability to a broad range of real-world applications. In this work, we present Qwen-Image-Layered 1.5, a pretrained unified image generation and editing model with native transparency awareness. By jointly modeling visual appearance and transparency, our framework supports a wide range of both raster-centric and transparency-aware tasks within a single model. Notably, we observe that the model can perform transparent image editing in a zero-shot manner. To systematically evaluate this new task, we introduce TransEdit-Bench, the first benchmark specifically designed for transparent image editing. Extensive experiments across various tasks demonstrate strong performance and highlight the great potential of transparency-native image modeling as a unified paradigm for future image synthesis and editing.
PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning
Jingcheng Hu | Yinmin Zhang | Shijie Shang | Xiaobo Yang | Yue Peng | Zhewei Huang | Hebin Zhou | Xin Wu | Jie Cheng | Fanqi Wan | Xiangwen Kong | Chengyuan Yao | Kaiwen Yan | Ailin Huang | Hongyu Zhou | Qi Han | Zheng Ge | Xiangyu Zhang | Heung-Yeung Shum
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Jingcheng Hu | Yinmin Zhang | Shijie Shang | Xiaobo Yang | Yue Peng | Zhewei Huang | Hebin Zhou | Xin Wu | Jie Cheng | Fanqi Wan | Xiangwen Kong | Chengyuan Yao | Kaiwen Yan | Ailin Huang | Hongyu Zhou | Qi Han | Zheng Ge | Xiangyu Zhang | Heung-Yeung Shum
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
We introduce Parallel Coordinated Reasoning (PaCoRe), a training-and-inference framework designed to overcome a central limitation of contemporary language models: their inability to scale test-time compute (TTC) far beyond sequential reasoning under a fixed context window. PaCoRe departs from the traditional sequential paradigm by driving TTC through massive parallel exploration coordinated via a message-passing architecture in multiple rounds. Each round launches many parallel reasoning trajectories, compacts their findings into context-bounded messages, and synthesizes these messages to guide the next round and ultimately produce the final answer. Trained end-to-end with large-scale, outcome-based reinforcement learning, the model masters the synthesis abilities required by PaCoRe and scales to multi-million-token effective TTC without exceeding context limits. The approach yields strong improvements across diverse domains and notably pushes reasoning beyond frontier systems in mathematics: an 8B model reaches 94.5% on HMMT 2025, surpassing GPT-5’s 93.2% by scaling effective TTC to roughly two million tokens. We open-source model checkpoints, training data, and the full inference pipeline to accelerate follow-up work.
2025
Multi-matrix Factorization Attention
Jingcheng Hu | Houyi Li | Yinmin Zhang | Zili Wang | Shuigeng Zhou | Xiangyu Zhang | Heung-Yeung Shum
Findings of the Association for Computational Linguistics: ACL 2025
Jingcheng Hu | Houyi Li | Yinmin Zhang | Zili Wang | Shuigeng Zhou | Xiangyu Zhang | Heung-Yeung Shum
Findings of the Association for Computational Linguistics: ACL 2025
We propose novel attention architectures, Multi-matrix Factorization Attention (MFA) and MFA-Key-Reuse (MFA-KR). Existing variants for standard Multi-Head Attention (MHA), including SOTA methods like MLA, fail to maintain as strong performance under stringent Key-Value cache (KV cache) constraints. MFA enhances model capacity by efficiently scaling up both the number and dimension of attention heads through low-rank matrix factorization in the Query-Key (QK) circuit. Extending MFA, MFA-KR further reduces memory requirements by repurposing the key cache as value through value projection re-parameterization. MFA’s design enables strong model capacity when working under tight KV cache budget, while MFA-KR is suitable for even harsher KV cache limits with minor performance trade-off. Notably, in our extensive and large-scale experiments, the proposed architecture outperforms MLA and performs comparably to MHA, while reducing KV cache usage by up to 56% and 93.7%, respectively.
Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investment
Saizhuo Wang | Hang Yuan | Leon Zhou | Lionel Ni | Heung-Yeung Shum | Jian Guo
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Saizhuo Wang | Hang Yuan | Leon Zhou | Lionel Ni | Heung-Yeung Shum | Jian Guo
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
One of the most important tasks in quantitative investment research is mining new alphas (effective trading signals or factors). Traditional alpha mining methods, either hand-crafted factor synthesis or algorithmic factor mining (e.g., search with genetic programming), have inherent limitations, especially in implementing the ideas of quant researchers. In this work, we propose a new alpha mining paradigm by introducing human-AI interaction, and a novel prompt engineering algorithmic framework to implement this paradigm by leveraging the power of large language models. Moreover, we develop Alpha-GPT, a new interactive alpha mining system framework that provides a heuristic way to “understand” the ideas of quant researchers and outputs creative, insightful, and effective alphas. We demonstrate the effectiveness and advantage of Alpha-GPT via a number of alpha mining experiments. In particular, we evaluated Alpha-GPT’s performance in the WorldQuant International Quant Championship, where it demonstrated results comparable to those of top-performing human participants, ranking among top-10 over 41000 teams worldwide. These findings suggest Alpha-GPT’s significant potential in generating highly effective alphas that may surpass human capabilities in quantitative investment strategies.
2020
The Design and Implementation of XiaoIce, an Empathetic Social Chatbot
Li Zhou | Jianfeng Gao | Di Li | Heung-Yeung Shum
Computational Linguistics, Volume 46, Issue 1 - March 2020
Li Zhou | Jianfeng Gao | Di Li | Heung-Yeung Shum
Computational Linguistics, Volume 46, Issue 1 - March 2020
This article describes the development of Microsoft XiaoIce, the most popular social chatbot in the world. XiaoIce is uniquely designed as an artifical intelligence companion with an emotional connection to satisfy the human need for communication, affection, and social belonging. We take into account both intelligent quotient and emotional quotient in system design, cast human–machine social chat as decision-making over Markov Decision Processes, and optimize XiaoIce for long-term user engagement, measured in expected Conversation-turns Per Session (CPS). We detail the system architecture and key components, including dialogue manager, core chat, skills, and an empathetic computing module. We show how XiaoIce dynamically recognizes human feelings and states, understands user intent, and responds to user needs throughout long conversations. Since the release in 2014, XiaoIce has communicated with over 660 million active users and succeeded in establishing long-term relationships with many of them. Analysis of large-scale online logs shows that XiaoIce has achieved an average CPS of 23, which is significantly higher than that of other chatbots and even human conversations.
2012
Twitter Topic Summarization by Ranking Tweets using Social Influence and Content Quality
Yajuan Duan | Zhumin Chen | Furu Wei | Ming Zhou | Heung-Yeung Shum
Proceedings of COLING 2012
Yajuan Duan | Zhumin Chen | Furu Wei | Ming Zhou | Heung-Yeung Shum
Proceedings of COLING 2012
2010
Search
Fix author
Co-authors
- Yajuan Duan 2
- Jingcheng Hu 2
- Lionel Ni 2
- Xiangyu Zhang 2
- Yinmin Zhang 2
- Ming Zhou 2
- Xiaoyue Chen 1
- Yilei Chen 1
- Yuxiang Chen 1
- Zhumin Chen 1
- Jie Cheng 1
- Jianfeng Gao 1
- Kaiyuan Gao 1
- Zheng Ge 1
- Jian Guo 1
- Qi Han 1
- Ailin Huang 1
- Zhewei Huang 1
- Lihan Jiang 1
- Long Jiang 1
- Xiangwen Kong 1
- Di Li 1
- Houyi Li 1
- Jiahao Li 1
- Zihao Liu 1
- Yue Peng 1
- Tao Qin 1
- Shijie Shang 1
- Yan Shu 1
- Ningyuan Tang 1
- Fanqi Wan 1
- Saizhuo Wang 1
- Zhendong Wang 1
- Zili Wang 1
- Furu Wei 1
- Chenfei Wu 1
- Tianhe Wu 1
- Xin Wu 1
- Xiao Xu 1
- Yixian Xu 1
- Kaiwen Yan 1
- Kun Yan 1
- Xiaobo Yang 1
- Chengyuan Yao 1
- Shengming Yin 1
- Hang Yuan 1
- Jie Zhang 1
- Yanran Zhang 1
- Zekai Zhang 1
- Hebin Zhou 1
- Hongyu Zhou 1
- Jingren Zhou 1
- Leon Zhou 1
- Li Zhou 1
- Shuigeng Zhou 1
- Zikai Zhou 1