On Cross-Language Entity Label Projection and Recognition

Paolo Gajo, Alberto Barrón-Cedeño


Abstract
Most work on named entity recognition (NER) focuses solely on English. Through the use of training data augmentation via machine translation (MT), multilingual NER can become a powerful tool for information extraction in multilingual contexts. In this paper, we augment NER data from culinary recipe ingredient lists, by means of MT and word alignment (WA), following two approaches: (i) translating each entity separately, while taking into account the full context of the list and (ii) translating the whole list of ingredients and then aligning entities using three types of WA models: Giza++, Fast Align, and BERT, fine-tuned using a novel entity-shuffling approach. We depart from English data and produce Italian versions via MT, span-annotated with the entities projected from English. Then, we use the data produced by the two approaches to train mono- and multilingual NER BERT models. We test the performance of the WA and NER models on an annotated dataset of ingredient lists, partially out-of-domain compared to the training data. The results show that shuffling entities leads to better BERT aligner models. The higher quality NER data created by these models enables NER models to achieve better results, with multilingual models reaching performances equal to or greater than their monolingual counterparts.
Anthology ID:
2024.clicit-1.47
Volume:
Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)
Month:
December
Year:
2024
Address:
Pisa, Italy
Editors:
Felice Dell'Orletta, Alessandro Lenci, Simonetta Montemagni, Rachele Sprugnoli
Venue:
CLiC-it
SIG:
Publisher:
CEUR Workshop Proceedings
Note:
Pages:
390–402
Language:
URL:
https://aclanthology.org/2024.clicit-1.47/
DOI:
Bibkey:
Cite (ACL):
Paolo Gajo and Alberto Barrón-Cedeño. 2024. On Cross-Language Entity Label Projection and Recognition. In Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024), pages 390–402, Pisa, Italy. CEUR Workshop Proceedings.
Cite (Informal):
On Cross-Language Entity Label Projection and Recognition (Gajo & Barrón-Cedeño, CLiC-it 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.clicit-1.47.pdf