Yizhou Yang
Author directory2026
Diagnosing and Mitigating Evidence Misgrounding in Multimodal Knowledge Editing
Zhiwu Wang | Yichen Wu | Jinqian Yang | Yizhou Yang | Renzhen Wang | Qian Zhao | Deyu Meng
Findings of the Association for Computational Linguistics: EMNLP 2026
Zhiwu Wang | Yichen Wu | Jinqian Yang | Yizhou Yang | Renzhen Wang | Qian Zhao | Deyu Meng
Findings of the Association for Computational Linguistics: EMNLP 2026
Multimodal knowledge editing aims to update visually grounded facts in Multimodal Large Language Models (MLLMs) while preserving unrelated text and visual behaviors. However, standard answer-level metrics can hide evidence misgrounding: an edit may produce the target answer on the original image yet remain sensitive to incidental context rather than the intended visual evidence. To examine this issue in a controlled setting, we construct WATERBIRD-EDIT, an analysis set that decouples bird habitat labels from background context and measures whether edited predictions remain stable when the target evidence is preserved but the background changes. Motivated by this diagnosis, we propose VICE (Visual In-Context Editing), a retrieval-based framework that stores edits in external memory and applies them through visual in-context demonstrations designed to expose task-relevant evidence. Experiments on three standard benchmarks show that VICE achieves strong lifelong editing performance, while results on WATERBIRD-EDIT show that it substantially reduces sensitivity to the controlled background shifts.
BIRD-History: A Benchmark for History-Driven Text-to-SQL with Fine-Grained Knowledge Annotations
Yunfan Zhou | Qiming Shi | Yizhou Yang | Di Weng | Yingcai Wu
Findings of the Association for Computational Linguistics: EMNLP 2026
Yunfan Zhou | Qiming Shi | Yizhou Yang | Di Weng | Yingcai Wu
Findings of the Association for Computational Linguistics: EMNLP 2026
While recent Large Language Model (LLM)-based text-to-SQL systems achieve impressive performance on standard benchmarks, they struggle when user queries implicitly rely on domain-specific knowledge, such as business logic, data conventions, and analytical practices, that is neither captured by the schema nor explicitly stated in the natural language question. Historical SQL query logs offer a valuable source of such knowledge, yet existing benchmarks do not adequately support evaluation of history-driven approaches. To address this gap, we introduce BIRD-History, a benchmark consisting of 1,393 tasks across 11 databases, designed to evaluate text-to-SQL systems’ ability to ground underspecified natural language questions using historical SQL scripts. Each task is annotated with ground-truth labels specifying which historical queries contain relevant knowledge and which SQL clauses encode it, enabling systematic evaluation of both retrieval effectiveness and knowledge utilization. Alongside the benchmark, we propose a plug-in retriever that extracts five types of external knowledge from historical SQL scripts, then retrieves and reranks relevant fragments for query generation. The retriever integrates seamlessly into existing few-shot text-to-SQL pipelines without requiring prompt modifications. Experiments demonstrate consistent improvements across four text-to-SQL systems, highlighting the value of leveraging historical query logs for handling underspecified queries. Dataset and code are open-sourced on https://github.com/zjuidg/BIRD-History.