SEA-LION-Embedding: Open and Reproducible Text Embeddings for Southeast Asia

Peerat Limkonchotiwat, Raymond Ng, Sarana Nutanong, Jian Gang Ngui


Abstract
Text embeddings are fundamental to many downstream applications, making robustness important for real-world NLP. However, most recent state-of-the-art embedding models are not reproducible because they rely on closed or undisclosed training data, and they remain insufficiently robust for Southeast Asian languages. We present SEA-LION-Embedding, a fully open and reproducible text-embedding pipeline for Southeast Asian languages trained only on publicly available data, and use it to study three core factors of robust embedding design: data composition, training objective, and base encoder initialization. SEA-LION-Embedding achieves state-of-the-art results on SEA-BED while enabling systematic and reproducible analysis of robust text embeddings for the region.
Anthology ID:
2026.findings-emnlp.1205
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
25455–25463
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1205/
DOI:
Bibkey:
Cite (ACL):
Peerat Limkonchotiwat, Raymond Ng, Sarana Nutanong, and Jian Gang Ngui. 2026. SEA-LION-Embedding: Open and Reproducible Text Embeddings for Southeast Asia. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 25455–25463, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SEA-LION-Embedding: Open and Reproducible Text Embeddings for Southeast Asia (Limkonchotiwat et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1205.pdf