Shenzhi Yang
Author directory2026
Can LLMs Spot Data Anomalies That Make Table QA Impossible?
Yucheng Wei | Shenzhi Yang | Ning Wang | Jinchang Zhang | Yuhang Yang | Haobo Wang | Liangyu Zha | Wentao Ye | Liyao Li | Cheng Peng | Gang Chen
Findings of the Association for Computational Linguistics: EMNLP 2026
Yucheng Wei | Shenzhi Yang | Ning Wang | Jinchang Zhang | Yuhang Yang | Haobo Wang | Liangyu Zha | Wentao Ye | Liyao Li | Cheng Peng | Gang Chen
Findings of the Association for Computational Linguistics: EMNLP 2026
Existing tabular reasoning benchmarks typically assume that input tables are clean and error-free, which contrasts sharply with real-world data pipelines where noise and anomalies are pervasive. While humans routinely validate tables and reject conclusions when anomalies render a question unanswerable, it remains unclear whether large language models (LLMs) exhibit similar anomaly awareness. In this work, we introduce AnTBench, a benchmark designed to systematically evaluate LLM behavior under anomalous tabular data. AnTBench consists of 1,571 curated instances covering five common and verifiable anomaly types. Experiments on 14 representative LLMs reveal a pronounced capability–behavior gap: even the strongest model achieves 76.07% on explicit anomaly detection, yet only 19.03% on spontaneous anomaly perception during standard table QA. As an inference-time mitigation, we introduce the Multi-Path Thinker, a multi-path reasoning framework. While this approach improves explicit anomaly detection, enforcing proactive verification for every query is practically prohibitive. We urge the community to move beyond inference-time patches and instill spontaneous anomaly awareness directly into the training and alignment phases. Our code and data are available at https://github.com/Wei12097/AnTBench.
2025
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning
Zhong Zhang | Yaxi Lu | Yikun Fu | Yupeng Huo | Shenzhi Yang | Yesai Wu | Han Si | Xin Cong | Haotian Chen | Yankai Lin | Jie Xie | Wei Zhou | Wang Xu | Yuanheng Zhang | Zhou Su | Zhongwu Zhai | Xiaoming Liu | Yudong Mei | Jianming Xu | Hongyan Tian | Chongyi Wang | Chi Chen | Yuan Yao | Zhiyuan Liu | Maosong Sun
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Zhong Zhang | Yaxi Lu | Yikun Fu | Yupeng Huo | Shenzhi Yang | Yesai Wu | Han Si | Xin Cong | Haotian Chen | Yankai Lin | Jie Xie | Wei Zhou | Wang Xu | Yuanheng Zhang | Zhou Su | Zhongwu Zhai | Xiaoming Liu | Yudong Mei | Jianming Xu | Hongyan Tian | Chongyi Wang | Chi Chen | Yuan Yao | Zhiyuan Liu | Maosong Sun
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Large language model agents have enabled GUI-based automation, particularly for mobile devices. However, deployment remains limited by noisy data, poor generalization, and lack of support for non-English GUIs. In this work, we present AgentCPM-GUI, an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction. Our training pipeline includes grounding-aware pre-training to enhance perception, supervised fine-tuning on high-quality Chinese and English trajectories to imitate human-like actions, and reinforcement fine-tuning with GRPO to improve reasoning capability. AgentCPM-GUI achieves promising performance on five public benchmarks and our proposed Chinese benchmark CAGUI. To facilitate reproducibility and further research, we publicly release all code, model checkpoint, and evaluation data at: https://github.com/OpenBMB/AgentCPM-GUI
Search
Fix author
Co-authors
- Chi Chen 1
- Gang Chen 1
- Haotian Chen 1
- Xin Cong 1
- Yikun Fu 1
- Yupeng Huo 1
- Liyao Li 1
- Yankai Lin (林衍凯) 1
- Xiaoming Liu 1
- Zhiyuan Liu 1
- Yaxi Lu 1
- Yudong Mei 1
- Cheng Peng 1
- Han Si (司函) 1
- Zhou Su 1
- Maosong Sun (孙茂松) 1
- Hongyan Tian 1
- Chongyi Wang 1
- Haobo Wang 1
- Ning Wang 1
- Yucheng Wei 1
- Yesai Wu 1
- Jie Xie 1
- Jianming Xu 1
- Wang Xu 1
- Yuhang Yang 1
- Yuan Yao 1
- Wentao Ye 1
- Liangyu Zha 1
- Zhongwu Zhai 1
- Jinchang Zhang 1
- Yuanheng Zhang 1
- Zhong Zhang 1
- Wei Zhou 1