Using Multimodal and Language-Agnostic Sentence Embeddings for Abstractive Summarization

Chaimae Chellaf El Hammoud, Salima Mdhaffar, Yannick Estève, Stéphane Huet


Abstract
Abstractive summarization aims to generate concise summaries by creating new sentences, allowing for flexible rephrasing. However, this approach can be vulnerable to inaccuracies, particularly ‘hallucinations’ where the model introduces non-existent information. In this paper, we leverage the use of multimodal and multilingual sentence embeddings derived from pre-trained models such as LaBSE, SONAR, and BGE-M3, and feed them into a modified BART-based French model. A Named Entity Injection mechanism that appends tokenized named entities to the decoder input is introduced, in order to improve the factual consistency of the generated summary. Our novel framework, SBARThez, is applicable to both text and speech inputs and supports cross-lingual summarization; it shows competitive performance relative to token-level baselines, especially for low-resource languages, while generating more concise and abstract summaries.
Anthology ID:
2026.lrec-1.774
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
9873–9883
Language:
External URL:
https://lrec.elra.info/lrec2026-main-774
DOI:
10.63317/59f6s77tynig
Bibkey:
Cite (ACL):
Chaimae Chellaf El Hammoud, Salima Mdhaffar, Yannick Estève, and Stéphane Huet. 2026. Using Multimodal and Language-Agnostic Sentence Embeddings for Abstractive Summarization. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 9873–9883, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
Using Multimodal and Language-Agnostic Sentence Embeddings for Abstractive Summarization (Chellaf El Hammoud et al., LREC 2026)
Copy Citation: