Zero-Shot Cross-Lingual NER Using Phonemic Representations for Low-Resource Languages

Jimin Sohn, Haeji Jung, Alex Cheng, Jooeon Kang, Yilin Du, David Mortensen


Abstract
Existing zero-shot cross-lingual NER approaches require substantial prior knowledge of the target language, which is impractical for low-resource languages.In this paper, we propose a novel approach to NER using phonemic representation based on the International Phonetic Alphabet (IPA) to bridge the gap between representations of different languages.Our experiments show that our method significantly outperforms baseline models in extremely low-resource languages, with the highest average F1 score (46.38%) and lowest standard deviation (12.67), particularly demonstrating its robustness with non-Latin scripts. Ourcodes are available at https://github.com/Gabriel819/zeroshot_ner.git
Anthology ID:
2024.emnlp-main.753
Volume:
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
13595–13602
Language:
URL:
https://aclanthology.org/2024.emnlp-main.753
DOI:
Bibkey:
Cite (ACL):
Jimin Sohn, Haeji Jung, Alex Cheng, Jooeon Kang, Yilin Du, and David Mortensen. 2024. Zero-Shot Cross-Lingual NER Using Phonemic Representations for Low-Resource Languages. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 13595–13602, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
Zero-Shot Cross-Lingual NER Using Phonemic Representations for Low-Resource Languages (Sohn et al., EMNLP 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.emnlp-main.753.pdf