Fishing for Magikarp: Automatically Detecting Under-trained Tokens in Large Language Models

Fishing for Magikarp: Automatically Detecting Under-trained Tokens in Large Language Models Sander Land author Max Bartolo author 2024-11 text Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing Yaser Al-Onaizan editor Mohit Bansal editor Yun-Nung Chen editor Association for Computational Linguistics Miami, Florida, USA conference publication land-bartolo-2024-fishing 10.18653/v1/2024.emnlp-main.649 https://aclanthology.org/2024.emnlp-main.649/ 2024-11 11631 11646