Transformer Language Models Handle Word Frequency in Prediction Head

Transformer Language Models Handle Word Frequency in Prediction Head Goro Kobayashi author Tatsuki Kuribayashi author Sho Yokoi author Kentaro Inui author 2023-07 text Findings of the Association for Computational Linguistics: ACL 2023 Anna Rogers editor Jordan Boyd-Graber editor Naoaki Okazaki editor Association for Computational Linguistics Toronto, Canada conference publication kobayashi-etal-2023-transformer 10.18653/v1/2023.findings-acl.276 https://aclanthology.org/2023.findings-acl.276/ 2023-07 4523 4535