Yang Shi
Author directoryOther people with similar names: Yang Shi, Yang Shi
Unverified author pages with similar names: Yang Shi
2026
MorphoBench: A Benchmark with Difficulty Adaptive to Model Reasoning
Xukai Wang | Xuanbo Liu | Mingrui Chen | Haitian Zhong | Xuanlin Yang | Bohan Zeng | Jinbo Hu | Hao Liang | Junbo Niu | Xuchen Li | Ruitao Wu | Ruichuan An | Yang Shi | Liu Liu | Qiang Liu | Zhouchen Lin | Xu-Yao Zhang | Wentao Zhang | Bin Dong
Findings of the Association for Computational Linguistics: ACL 2026
Xukai Wang | Xuanbo Liu | Mingrui Chen | Haitian Zhong | Xuanlin Yang | Bohan Zeng | Jinbo Hu | Hao Liang | Junbo Niu | Xuchen Li | Ruitao Wu | Ruichuan An | Yang Shi | Liu Liu | Qiang Liu | Zhouchen Lin | Xu-Yao Zhang | Wentao Zhang | Bin Dong
Findings of the Association for Computational Linguistics: ACL 2026
With the advancement of powerful large-scale reasoning models, effectively evaluating the reasoning capabilities of these models has become increasingly important. However, existing benchmarks designed to assess the reasoning abilities of large models tend to be limited in scope and lack the flexibility to adapt their difficulty according to the evolving reasoning capacities of the models. To address this, we propose MorphoBench, a benchmark that incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models. Specifically, we curate the benchmark by selecting and collecting complex reasoning questions from existing benchmarks and sources such as Olympiad-level competitions. Additionally, MorphoBench adaptively modifies the analytical challenge of questions by leveraging key statements generated during the model’s reasoning process. Furthermore, it includes questions generated using simulation software, enabling dynamic adjustment of benchmark difficulty with minimal resource consumption. We have gathered over 1,300 test questions and iteratively adjusted the difficulty of MorphoBench based on the reasoning capabilities of models such as GPT-5 and Gemini-3-Pro. MorphoBench enhances the comprehensiveness and validity of model reasoning evaluation, providing reliable guidance for improving both the reasoning abilities and scientific robustness of large models.
CapRiCorn-1K: A Comprehensive Benchmark for Video Captioning and Subject Referential Consistency Across Temporal Scales
Xinlong Chen | Jiafu Tang | Yue Ding | Yizhuo Jia | Bozhou Li | Bohan Zeng | Yang Shi | Shihao Li | Yiyan Ji | Qiang Liu | Weihong Lin | Yuanxing Zhang | Pengfei Wan | Liang Wang | Tieniu Tan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Xinlong Chen | Jiafu Tang | Yue Ding | Yizhuo Jia | Bozhou Li | Bohan Zeng | Yang Shi | Shihao Li | Yiyan Ji | Qiang Liu | Weihong Lin | Yuanxing Zhang | Pengfei Wan | Liang Wang | Tieniu Tan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Accurate and comprehensive video captions with consistent subject references are critical for downstream understanding and generation tasks. However, few existing benchmarks can objectively and comprehensively evaluate these properties across diverse durations and scenarios, thereby hindering the advancement of video captioning models. To bridge this gap, we propose CapRiCorn-1K, a comprehensive benchmark designed to evaluate both video captioning quality and subject referential consistency across long temporal horizons and diverse video domains. To accommodate varied evaluation needs, our benchmark supports both audiovisual and visual-only settings. Extensive experiments on CapRiCorn-1K reveal that current models generally struggle to generate accurate and comprehensive captions while maintaining consistent subject references. Moreover, as video duration increases, both the overall caption quality and subject referential consistency decline. Notably, our evaluation metrics exhibit strong correlations with the performance of downstream understanding and generation tasks conditioned on the generated captions, further validating their effectiveness. CapRiCorn-1K will be fully open-sourced to facilitate future research.
Search
Fix author
Co-authors
- Qiang Liu 2
- Bohan Zeng 2
- Ruichuan An 1
- Mingrui Chen 1
- Xinlong Chen 1
- Yue Ding 1
- Bin Dong 1
- Jinbo Hu 1
- Yiyan Ji 1
- Yizhuo Jia 1
- Bozhou Li 1
- Shihao Li 1
- Xuchen Li 1
- Hao Liang 1
- Weihong Lin 1
- Zhouchen Lin 1
- Liu Liu 1
- Xuanbo Liu 1
- Junbo Niu 1
- Tieniu Tan 1
- Jiafu Tang 1
- Pengfei Wan 1
- Liang Wang 1
- Xukai Wang 1
- Ruitao Wu 1
- Xuanlin Yang 1
- Wentao Zhang 1
- Xu-Yao Zhang 1
- Yuanxing Zhang 1
- Haitian Zhong 1