Xiaoyu Chen

Author directory

Other people with similar names: Xiaoyu Chen, Xiaoyu Chen, Xiaoyu Chen

Unverified author pages with similar names: Xiaoyu Chen


2026

Recent MLLMs have shown promise in scene-text-aware video understanding, yet their ability to understand scene text from the wearer’s perspective in AI-glasses videos remains underexplored. AI-glasses videos are passively captured without a camera-frame preview, limiting the wearer’s ability to adjust framing during recording. As a result, relevant text may be unstable, and the recorded view may not fully reflect the wearer’s attention. The challenge is thus not merely to read visible text, but to identify and read the right text given the wearer’s position, viewpoint trajectory, and goal. To systematically evaluate this capability, we introduce **WearerText**, a benchmark for **Wearer**-Centered Scene **Text** Understanding, comprising 1,101 real-world AI-glasses videos and 15,336 QA pairs spanning 13 tasks. These tasks are organized into a three-level diagnostic hierarchy: *L1 Text Perception*, *L2 Contextual Understanding*, and *L3 Wearer-Grounded Reasoning*, targeting unstable text perception, wearer-view alignment, and goal-oriented text reasoning, respectively. To ensure reliable construction and evaluation, we develop **MAH-V**, a multi-agent hybrid verification pipeline for QA construction, and propose **VerEval**, a Verified-evidence metric for open-ended Evaluation. Benchmarking 20 recent MLLMs shows that current models still struggle with wearer-centered scene text understanding, particularly on tasks requiring wearer-view alignment and goal-oriented text reasoning.