HerBERT: Efficiently Pretrained Transformer-based Language Model for Polish

HerBERT: Efficiently Pretrained Transformer-based Language Model for Polish Robert Mroczkowski author Piotr Rybak author Alina Wróblewska author Ireneusz Gawlik author 2021-04 text Proceedings of the 8th Workshop on Balto-Slavic Natural Language Processing Bogdan Babych editor Olga Kanishcheva editor Preslav Nakov editor Jakub Piskorski editor Lidia Pivovarova editor Vasyl Starko editor Josef Steinberger editor Roman Yangarber editor Michał Marcińczuk editor Senja Pollak editor Pavel Přibáň editor Marko Robnik-Šikonja editor Association for Computational Linguistics Kiyv, Ukraine conference publication mroczkowski-etal-2021-herbert https://aclanthology.org/2021.bsnlp-1.1/ 2021-04 1 10