Exploring the Limits of Simple Learners in Knowledge Distillation for Document Classification with DocBERT Ashutosh Adhikari author Achyudh Ram author Raphael Tang author William L Hamilton author Jimmy Lin author 2020-07 text Proceedings of the 5th Workshop on Representation Learning for NLP Spandana Gella editor Johannes Welbl editor Marek Rei editor Fabio Petroni editor Patrick Lewis editor Emma Strubell editor Minjoon Seo editor Hannaneh Hajishirzi editor Association for Computational Linguistics Online conference publication adhikari-etal-2020-exploring 10.18653/v1/2020.repl4nlp-1.10 https://aclanthology.org/2020.repl4nlp-1.10/ 2020-07 72 77