MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers

MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers Mohammadmahdi Nouriborji author Omid Rohanian author Samaneh Kouchaki author David A Clifton author 2023-05 text Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics Andreas Vlachos editor Isabelle Augenstein editor Association for Computational Linguistics Dubrovnik, Croatia conference publication nouriborji-etal-2023-minialbert 10.18653/v1/2023.eacl-main.83 https://aclanthology.org/2023.eacl-main.83/ 2023-05 1161 1173