2021

pdf bib
On the Distribution, Sparsity, and Inference-time Quantization of Attention Values in Transformers
Tianchu Ji | Shraddhan Jain | Michael Ferdman | Peter Milder | H. Andrew Schwartz | Niranjan Balasubramanian
Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021