Mengchao Zhang
Author directory2026
WearerText: Benchmarking Wearer-Centered Scene Text Understanding in AI-Glasses Videos
Yaping Zhang | Mei Tu | Jinting Wu | Qixuan Zhang | Xiaoyu Chen | Mengchao Zhang | Yuchen Huang | Junshen Chen | Fan Zhang | Lu Xiang | Junnan Zhu | Yang Zhao | Yu Zhou | Chengqing Zong
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yaping Zhang | Mei Tu | Jinting Wu | Qixuan Zhang | Xiaoyu Chen | Mengchao Zhang | Yuchen Huang | Junshen Chen | Fan Zhang | Lu Xiang | Junnan Zhu | Yang Zhao | Yu Zhou | Chengqing Zong
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Recent MLLMs have shown promise in scene-text-aware video understanding, yet their ability to understand scene text from the wearer’s perspective in AI-glasses videos remains underexplored. AI-glasses videos are passively captured without a camera-frame preview, limiting the wearer’s ability to adjust framing during recording. As a result, relevant text may be unstable, and the recorded view may not fully reflect the wearer’s attention. The challenge is thus not merely to read visible text, but to identify and read the right text given the wearer’s position, viewpoint trajectory, and goal. To systematically evaluate this capability, we introduce **WearerText**, a benchmark for **Wearer**-Centered Scene **Text** Understanding, comprising 1,101 real-world AI-glasses videos and 15,336 QA pairs spanning 13 tasks. These tasks are organized into a three-level diagnostic hierarchy: *L1 Text Perception*, *L2 Contextual Understanding*, and *L3 Wearer-Grounded Reasoning*, targeting unstable text perception, wearer-view alignment, and goal-oriented text reasoning, respectively. To ensure reliable construction and evaluation, we develop **MAH-V**, a multi-agent hybrid verification pipeline for QA construction, and propose **VerEval**, a Verified-evidence metric for open-ended Evaluation. Benchmarking 20 recent MLLMs shows that current models still struggle with wearer-centered scene text understanding, particularly on tasks requiring wearer-view alignment and goal-oriented text reasoning.