Beyond Single-Negative Preference: Multi-Negative DPO for LLM-Centric Historical Entity Linking

Tien Nam Nguyen, Emanuela Boros, Ahmed Hamdi, Adam Jatowt, Mickael Coustaty, Antoine Doucet


Abstract
Large language models (LLMs) have recently shown promise for historical entity linking, but preference optimization for this task is often formulated with only one negative candidate per training instance. This discards information from the remaining candidates retrieved for the same mention. We introduce multi-negative direct preference optimisation (MDPO), a reference-based pairwise objective that compares the correct entity with all valid rejected candidates associated with each mention. MDPO preserves the Bradley-Terry formulation of DPO while exploiting the complete candidate set through masked, length-normalised sequence scores. We evaluate MDPO on hipe-2020 and newseye, covering French, German, English, Swedish, and Finnish historical newspaper text. Experiments show that MDPO improves over supervised fine-tuning and single-negative DPO, with particularly strong gains for NIL mentions, semantic ambiguity, OCR noise, and historically difficult names. Further analyses disentangle candidate-generation and selection errors, showing that candidate retrieval remains a key bottleneck for end-to-end entity linking. These results demonstrate that incorporating all within-instance negative candidates is a simple and effective improvement for LLM-based historical entity linking.
Anthology ID:
2026.findings-emnlp.1873
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
39970–39985
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1873/
DOI:
Bibkey:
Cite (ACL):
Tien Nam Nguyen, Emanuela Boros, Ahmed Hamdi, Adam Jatowt, Mickael Coustaty, and Antoine Doucet. 2026. Beyond Single-Negative Preference: Multi-Negative DPO for LLM-Centric Historical Entity Linking. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 39970–39985, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Beyond Single-Negative Preference: Multi-Negative DPO for LLM-Centric Historical Entity Linking (Nguyen et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1873.pdf