Characterizing and addressing the issue of oversmoothing in neural autoregressive sequence modeling

Characterizing and addressing the issue of oversmoothing in neural autoregressive sequence modeling Ilia Kulikov author Maksim Eremeev author Kyunghyun Cho author 2022-11 text Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) Yulan He editor Heng Ji editor Sujian Li editor Yang Liu editor Chua-Hui Chang editor Association for Computational Linguistics Online only conference publication kulikov-etal-2022-characterizing 10.18653/v1/2022.aacl-main.82 https://aclanthology.org/2022.aacl-main.82/ 2022-11 1115 1124