Ziwei Zhao
Author directoryOther people with similar names: Ziwei Zhao
2026
ScopeBench: Evaluating Cultural Norm Scope Awareness in LLMs
Haojun Liang | Ziwei Zhao | Chenyu Li | Qiyue Zhao | Rongduomijia Mu | Yulan Shen | Yu Gu | Chen Zhang | Kairui Zhang | Yanbiao Ma | Wenxuan Wang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Haojun Liang | Ziwei Zhao | Chenyu Li | Qiyue Zhao | Rongduomijia Mu | Yulan Shen | Yu Gu | Chen Zhang | Kairui Zhang | Yanbiao Ma | Wenxuan Wang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Safety evaluation in large language models treats harm as culturally invariant, yet a model cannot correctly apply a safety norm without knowing whose norms bind. We introduce ScopeBench, a benchmark that treats cultural scope as a first-class safety dimension. It comprises 3,323 norms spanning 49 countries across nine cultural clusters, each annotated as Universal or Specific. We define three scope error types identically across four evaluation tasks: Scope Inflation, Scope Deflation, and Scope Displacement. Evaluating 21 frontier LLMs across seven model families, we surface three structural failures. First, the dominant error type inverts with prompt format: Scope Deflation reaches 70% in single-answer classification, while Scope Inflation reaches 33% when each candidate culture is judged independently. Second, scope-classification accuracy is empirically decoupled from behavioral safety: the six classifiers achieving ≥97% Task 1 accuracy still produce harmful responses to 40–42% of scope-violating statements. Third, no model is safe in interaction, with harmful-response rates ranging from 29% to 51% across the cohort, excluding one model that systematically refuses the task. We release all data, code, and model outputs to establish cultural scope as a distinct alignment axis.
MessToClean: Evidence-Grounded Structure-Preserving Reconstruction for Real-World Degraded Exam Paper Images
Jiayi Tuo | Cheng Tang | Zihan Wang | Chenyue Zhou | Yao Li | Yanbiao Ma | Chao Wang | Wei Dai | Mingxuan Wang | Shitong Qin | Ziwei Zhao
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Jiayi Tuo | Cheng Tang | Zihan Wang | Chenyue Zhou | Yao Li | Yanbiao Ma | Chao Wang | Wei Dai | Mingxuan Wang | Shitong Qin | Ziwei Zhao
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Intelligent education systems often collect exam sheets as in-the-wild photos. These photos often suffer from distortions and noise caused by handwriting and occlusions, collectively referred to as Real-World Degraded Exam Images (RDEI). Structure-preserving reconstruction is key to converting RDEI into structured assets for downstream educational applications. Existing Multimodal Large Language Models (MLLMs) often fail under RDEI, leading to disrupted structure and evidence-unsupported hallucinations. To tackle these challenges, we propose MessToClean, a backbone-agnostic, evidence-driven pipeline that treats off-the-shelf MLLMs as interchangeable components. By grounding extraction in pixel-aligned evidence and enforcing post-hoc consistency auditing on recovered structures, MessToClean mitigates unsupported hallucinations and enhances both controllability and structural fidelity in question-level reconstruction. We curate RDEI-Exam from our educational platforms and evaluate across 12 state-of-the-art MLLM backbones. Across these, MessToClean improves stem consistency by 1.01-3.18%, figure consistency by 0.50-49.16%, and refusal F1 by 1.06-10.88% across question types.