DynamicER: Resolving Emerging Mentions to Dynamic Entities for RAG

Jinyoung Kim, Dayoon Ko, Gunhee Kim


Abstract
In the rapidly evolving landscape of language, resolving new linguistic expressions in continuously updating knowledge bases remains a formidable challenge. This challenge becomes critical in retrieval-augmented generation (RAG) with knowledge bases, as emerging expressions hinder the retrieval of relevant documents, leading to generator hallucinations. To address this issue, we introduce a novel task aimed at resolving emerging mentions to dynamic entities and present DynamicER benchmark. Our benchmark includes dynamic entity mention resolution and entity-centric knowledge-intensive QA task, evaluating entity linking and RAG model’s adaptability to new expressions, respectively. We discovered that current entity linking models struggle to link these new expressions to entities. Therefore, we propose a temporal segmented clustering method with continual adaptation, effectively managing the temporal dynamics of evolving entities and emerging mentions. Extensive experiments demonstrate that our method outperforms existing baselines, enhancing RAG model performance on QA task with resolved mentions.
Anthology ID:
2024.emnlp-main.762
Volume:
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
13752–13770
Language:
URL:
https://aclanthology.org/2024.emnlp-main.762
DOI:
Bibkey:
Cite (ACL):
Jinyoung Kim, Dayoon Ko, and Gunhee Kim. 2024. DynamicER: Resolving Emerging Mentions to Dynamic Entities for RAG. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 13752–13770, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
DynamicER: Resolving Emerging Mentions to Dynamic Entities for RAG (Kim et al., EMNLP 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.emnlp-main.762.pdf
Software:
 2024.emnlp-main.762.software.zip
Data:
 2024.emnlp-main.762.data.zip