Ying He
Papers on this page may belong to the following people: Ying He, Ying Tiffany He
2026
Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial Documents
Ying He | Zhouhong Gu | Zhecheng Hu | Yubo Zhou | Hao Shen | Jiaqing Liang | Zhaoqian Dai | Ma Shuguang | Fei Yu | Yanghua Xiao | Zhixu Li
Findings of the Association for Computational Linguistics: ACL 2026
Ying He | Zhouhong Gu | Zhecheng Hu | Yubo Zhou | Hao Shen | Jiaqing Liang | Zhaoqian Dai | Ma Shuguang | Fei Yu | Yanghua Xiao | Zhixu Li
Findings of the Association for Computational Linguistics: ACL 2026
Ensuring the accuracy of financial documents is critical for economic analysis, regulatory compliance, and corporate decision-making. Several studies have shown that Large Language Models (LLMs) perform well in many financial tasks, such as stock price movements and financial analytics. However, a critical task remains unexplored: the ability of LLMs to identify errors in financial documents. In this paper, we introduce FinED-Bench, the first publicly Benchmark for Financial Error Detection across three levels of cognitive complexity. FinED-Bench covers nine real-world financial scenarios, and includes over 900 documents reported in 2025 that are unseen by existing language models. We detail the benchmark construction process and evaluate several advanced LLMs (e.g., GPT-4o, Qwen3-14B) on this tasks, which requires both financial domain knowledge and reasoning capabilities. Experimental results show that current LLMs still struggle with this task, especially in high-complexity cases. Besides, supervised fine-tuning can significantly improve the performance of weaker LLMs on this task. Our data and code are available at https://anonymous.4open.science/r/FinED-Bench-406F.
The “Knowledge–Behavior Gap” in Cultural Taboo Safety of Large Language Models
Ying He | Sihang Jiang | Xingzhou Chen | Zhouhong Gu | Yiwei Gu | Minggui HE | Shimin Tao | Mahongxia | Yanghua Xiao
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Ying He | Sihang Jiang | Xingzhou Chen | Zhouhong Gu | Yiwei Gu | Minggui HE | Shimin Tao | Mahongxia | Yanghua Xiao
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Cultural taboo safety is essential for deploying large language models (LLMs), as culturally insensitive outputs may cause offense or even social harm. However, existing cultural benchmarks primarily assess cultural knowledge or values biases, while overlooking whether LLMs can recognize and respect cultural taboos, especially when taboos are implicitly hidden in seemingly harmless questions. Besides, cultural taboos are implicit, and context-dependent, thus poss unique challenges for reliable evaluation. To address these gaps, we introduce CulShield, the first public benchmark dedicated to evaluating and improving the cultural taboo safety of LLMs. CulShield spans 77 countries and regions, and includes over 2,020 taboos. It evaluates models along both explicit knowledge and implicit behaviors.Experiments on several advanced LLMs (e.g., GPT-4o-mini, Gemini-2.5-pro) reveal a clear “knowledge-behavior gap”: models often fail to apply known taboos during interaction. We further show that variations in linguistic context can significantly affect LLMs’ cultural taboo safety. Code and data is accessible here: https://anonymous.4open.science/r/CulShield-7A0E.