Diversity-Aware Batch Active Learning for Dependency Parsing

Tianze Shi, Adrian Benton, Igor Malioutov, Ozan İrsoy


Abstract
While the predictive performance of modern statistical dependency parsers relies heavily on the availability of expensive expert-annotated treebank data, not all annotations contribute equally to the training of the parsers. In this paper, we attempt to reduce the number of labeled examples needed to train a strong dependency parser using batch active learning (AL). In particular, we investigate whether enforcing diversity in the sampled batches, using determinantal point processes (DPPs), can improve over their diversity-agnostic counterparts. Simulation experiments on an English newswire corpus show that selecting diverse batches with DPPs is superior to strong selection strategies that do not enforce batch diversity, especially during the initial stages of the learning process. Additionally, our diversity-aware strategy is robust under a corpus duplication setting, where diversity-agnostic sampling strategies exhibit significant degradation.
Anthology ID:
2021.naacl-main.207
Volume:
Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Month:
June
Year:
2021
Address:
Online
Editors:
Kristina Toutanova, Anna Rumshisky, Luke Zettlemoyer, Dilek Hakkani-Tur, Iz Beltagy, Steven Bethard, Ryan Cotterell, Tanmoy Chakraborty, Yichao Zhou
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2616–2626
Language:
URL:
https://aclanthology.org/2021.naacl-main.207
DOI:
10.18653/v1/2021.naacl-main.207
Bibkey:
Cite (ACL):
Tianze Shi, Adrian Benton, Igor Malioutov, and Ozan İrsoy. 2021. Diversity-Aware Batch Active Learning for Dependency Parsing. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 2616–2626, Online. Association for Computational Linguistics.
Cite (Informal):
Diversity-Aware Batch Active Learning for Dependency Parsing (Shi et al., NAACL 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.naacl-main.207.pdf
Video:
 https://aclanthology.org/2021.naacl-main.207.mp4
Code
 tzshi/dpp-al-parsing-naacl21