How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models

How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models Phillip Rust author Jonas Pfeiffer author Ivan Vulić author Sebastian Ruder author Iryna Gurevych author 2021-08 text Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) Chengqing Zong editor Fei Xia editor Wenjie Li editor Roberto Navigli editor Association for Computational Linguistics Online conference publication rust-etal-2021-good 10.18653/v1/2021.acl-long.243 https://aclanthology.org/2021.acl-long.243/ 2021-08 3118 3135