Zeyi Liu
Author directory2026
CUADebug: Diagnosing and Repairing Computer-Use Agent Failures
Weijia Zhang | Kunlun Zhu | Zeyi Liu | Yinting Chen | Tianyi Ma | Jiateng Liu | Jiaxun Zhang | Bingxuan Li | Pan Lu | Xiangru Tang | Heng Ji | Jiaxuan You
Findings of the Association for Computational Linguistics: EMNLP 2026
Weijia Zhang | Kunlun Zhu | Zeyi Liu | Yinting Chen | Tianyi Ma | Jiateng Liu | Jiaxun Zhang | Bingxuan Li | Pan Lu | Xiangru Tang | Heng Ji | Jiaxuan You
Findings of the Association for Computational Linguistics: EMNLP 2026
Computer-use agents (CUAs) interact with graphical interfaces through screenshots and low-level mouse and keyboard actions, yet the causal error may precede the terminal failure. We present **CUADebug**, a framework for localizing root causes in CUA trajectories and guiding re-execution. **CUADebug** includes a five-category, 30-subtype taxonomy; CUAErrorBench, a benchmark of 204 failed OSWorld trajectories with human root-cause annotations; and CUADebugger, a ReAct-style agent for root-cause analysis (RCA). CUADebugger iteratively selects trajectory steps, inspects paired before/after screenshots and action traces, and submits a structured diagnosis containing the causal step, taxonomy label, grounded evidence, and correction. CUADebugger performs RCA without per-trajectory human intervention; human annotations are used to evaluate RCA predictions and, in controlled re-rollout comparisons, to fix restart points. Task reasoning and control is the largest annotated failure category (110/204). CUADebugger improves L2 and Tag+Step Exact across three debugger backbones on the Claude-agent split; with Gemini 2.5 Pro, Tag+Step Exact rises from 11.1% to 19.4%. Single re-execution improves failure recovery from 13.89% to 29.86% (overall 61.77% to 68.14%); controlled continual re-execution improves it from 12.50% to 25.69% (overall 61.22% to 66.48%). Project page: cuadebug.github.io
VGI-Bench: Probing Visual Intelligence in Video Generation Models
Xuan He | Cong Wei | Yuhao Cheng | Linrui Ma | Yuxuan Zhang | Zuojun Li | Yuhao Wen | Jize Jiang | Zeyi Liu | Yuren Hao | Songcheng Cai | Keming Wu | Penghui Du | Kai Zou | Rui Yang | Chenkai Sun | Ke Yang | Ping Nie | Kelsey R Allen | Chenglong Wang | Michel Galley | Jianfeng Gao | ChengXiang Zhai
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Xuan He | Cong Wei | Yuhao Cheng | Linrui Ma | Yuxuan Zhang | Zuojun Li | Yuhao Wen | Jize Jiang | Zeyi Liu | Yuren Hao | Songcheng Cai | Keming Wu | Penghui Du | Kai Zou | Rui Yang | Chenkai Sun | Ke Yang | Ping Nie | Kelsey R Allen | Chenglong Wang | Michel Galley | Jianfeng Gao | ChengXiang Zhai
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Recent studies suggest that video generative models can exhibit certain forms of zero-shot visual reasoning through generated frames. Yet reliable evaluation remains challenging: benchmarks should adopt inputs aligned with the visual priors of current video models, require valid evolving processes rather than only plausible final states, and calibrate task difficulty to remain challenging yet partly feasible. To this end, we introduce VGI-Bench, containing 27 tasks and 810 instances, organized by a two-level taxonomy of domains and skill tags for evaluating the visual reasoning capabilities of video generative models. Our evaluations show that current generative systems can solve a subset of visually grounded reasoning tasks, but remain far from reliable, with even the strongest model, Seedance 2.0, achieving only 51.0% under our evaluation criteria. Our findings further reveal the input sensitivity, skill-bounded transfer from synthetic fine-tuning, and limited denoising-time self-correction, where later steps mainly refine early hypotheses rather than correct reasoning errors. We hope VGI-Bench will help stimulate the development of next-generation video generative models. Data and code are available at [our project page](https://hexuan21.github.io/VGI-Bench/).
Search
Fix author
Co-authors
- Kelsey R Allen 1
- Songcheng Cai 1
- Yinting Chen 1
- Yuhao Cheng 1
- Penghui Du 1
- Michel Galley 1
- Jianfeng Gao 1
- Yuren Hao 1
- Xuan He 1
- Heng Ji 1
- Jize Jiang 1
- Bingxuan Li 1
- Zuojun Li 1
- Jiateng Liu 1
- Pan Lu 1
- Linrui Ma 1
- Tianyi Ma 1
- Ping Nie 1
- Chenkai Sun 1
- Xiangru Tang 1
- Chenglong Wang 1
- Cong Wei 1
- Yuhao Wen 1
- Keming Wu 1
- Ke Yang 1
- Rui Yang 1
- Jiaxuan You 1
- ChengXiang Zhai 1
- Jiaxun Zhang 1
- Weijia Zhang 1
- Yuxuan Zhang 1
- Kunlun Zhu 1
- Kai Zou 1