Zero-Shot Cross-Lingual Transfer is a Hard Baseline to Beat in German Fine-Grained Entity Typing

Sabine Weber, Mark Steedman


Abstract
The training of NLP models often requires large amounts of labelled training data, which makes it difficult to expand existing models to new languages. While zero-shot cross-lingual transfer relies on multilingual word embeddings to apply a model trained on one language to another, Yarowski and Ngai (2001) propose the method of annotation projection to generate training data without manual annotation. This method was successfully used for the tasks of named entity recognition and coarse-grained entity typing, but we show that it is outperformed by zero-shot cross-lingual transfer when applied to the similar task of fine-grained entity typing. In our study of fine-grained entity typing with the FIGER type ontology for German, we show that annotation projection amplifies the English model’s tendency to underpredict level 2 labels and is beaten by zero-shot cross-lingual transfer on three novel test sets.
Anthology ID:
2021.insights-1.7
Volume:
Proceedings of the Second Workshop on Insights from Negative Results in NLP
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Editors:
João Sedoc, Anna Rogers, Anna Rumshisky, Shabnam Tafreshi
Venue:
insights
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
42–48
Language:
URL:
https://aclanthology.org/2021.insights-1.7
DOI:
10.18653/v1/2021.insights-1.7
Bibkey:
Cite (ACL):
Sabine Weber and Mark Steedman. 2021. Zero-Shot Cross-Lingual Transfer is a Hard Baseline to Beat in German Fine-Grained Entity Typing. In Proceedings of the Second Workshop on Insights from Negative Results in NLP, pages 42–48, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Zero-Shot Cross-Lingual Transfer is a Hard Baseline to Beat in German Fine-Grained Entity Typing (Weber & Steedman, insights 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.insights-1.7.pdf
Video:
 https://aclanthology.org/2021.insights-1.7.mp4
Data
FIGERWikiMatrix