Qianxi Yu
Author directory2026
REMP: A Structured Event-Probing Benchmark for Long-Horizon Role-Playing Dialogue
Qianxi Yu | Yuhao Dan | Qingchun Bai | Qin Chen | Jie Zhou | Liang He
Findings of the Association for Computational Linguistics: EMNLP 2026
Qianxi Yu | Yuhao Dan | Qingchun Bai | Qin Chen | Jie Zhou | Liang He
Findings of the Association for Computational Linguistics: EMNLP 2026
Large language models (LLMs) are increasingly used in role-playing applications, yet evaluating whether they maintain character-consistent behavior over extended interactions remains challenging. Existing benchmarks mostly focus on short exchanges, static long-context inputs, or isolated aspects of role-playing, making long-horizon failures difficult to diagnose. We present REMP (Relationship-Emotion-Memory-Persona), a structured event-probing benchmark for long-horizon role-playing dialogue. REMP constructs multi-chapter dialogue trajectories from character profiles and embeds diagnostic probe events targeting persona consistency, emotional consistency, memory integrity, and relational continuity. We further introduce REMP-EVAL, an anchor-based multi-turn evaluation protocol that assesses model behavior after event triggers using dimension-specific references. The current release contains 160 characters organized into 80 dialogue trajectories, each averaging about 60 sessions and 800 turns. Experiments on 11 LLMs show that memory integrity and emotional consistency are the main bottlenecks, indicating that long-horizon role-playing requires not only long-context retrieval but also sustained affective and relational consistency.
PLANE: Plug-and-Play Fine-Grained Visual Experts for Hallucination Mitigation in Large Vision-Language Models
Jianghao Yin | Lang Yu | Qianxi Yu | Qin Chen | Jie Zhou | Zhikai Lei | Liang He
Findings of the Association for Computational Linguistics: EMNLP 2026
Jianghao Yin | Lang Yu | Qianxi Yu | Qin Chen | Jie Zhou | Zhikai Lei | Liang He
Findings of the Association for Computational Linguistics: EMNLP 2026
Large Vision-Language Models (LVLMs) commonly suffer from hallucinations, which appear as fabricating non-existent objects or outputting incorrect attributes and spatial relationships in images. Previous works empirically indicate that CLIP-style vision encoders tend to focus on primary objects while ignoring image details, which is one of the causes of hallucinations. To address this issue, we propose plug-and-play fine-grained visual experts (PLANE) comprising two components: LoRA visual experts operating on CLIP for multi-aspect image encoding, and an instruction-aware gate network for adaptive image feature fusion. During training, we construct a fine-grained image-caption pairs dataset, where images are described from three aspects: objects, attributes, and relations between objects. Image-caption pairs from different aspects are used to train the three fine-grained LoRA experts respectively. Aiming at comprehensively evaluate our method’s capabilities, we manually annotate a fine-grained hallucination evaluation benchmark for LVLMs which is GPT4-independent during evaluation phase (GIFT). We conduct experiments both on popular hallucination evaluation benchmarks and GIFT. The results show that our method effectively reduces hallucinations across models of different types and sizes while introducing minimal inference latency. Compared to advanced baselines, our model also demonstrates superior performance.