FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction

Minh Van Nguyen, Nghia Ngo, Bonan Min, Thien Nguyen


Abstract
This paper presents FAMIE, a comprehensive and efficient active learning (AL) toolkit for multilingual information extraction. FAMIE is designed to address a fundamental problem in existing AL frameworks where annotators need to wait for a long time between annotation batches due to the time-consuming nature of model training and data selection at each AL iteration. This hinders the engagement, productivity, and efficiency of annotators. Based on the idea of using a small proxy network for fast data selection, we introduce a novel knowledge distillation mechanism to synchronize the proxy network with the main large model (i.e., BERT-based) to ensure the appropriateness of the selected annotation examples for the main model. Our AL framework can support multiple languages. The experiments demonstrate the advantages of FAMIE in terms of competitive performance and time efficiency for sequence labeling with AL. We publicly release our code (https://github.com/nlp-uoregon/famie) and demo website (http://nlp.uoregon.edu:9000/). A demo video for FAMIE is provided at: https://youtu.be/I2i8n_jAyrY
Anthology ID:
2022.naacl-demo.14
Volume:
Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: System Demonstrations
Month:
July
Year:
2022
Address:
Hybrid: Seattle, Washington + Online
Editors:
Hannaneh Hajishirzi, Qiang Ning, Avi Sil
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
131–139
Language:
URL:
https://aclanthology.org/2022.naacl-demo.14
DOI:
10.18653/v1/2022.naacl-demo.14
Bibkey:
Cite (ACL):
Minh Van Nguyen, Nghia Ngo, Bonan Min, and Thien Nguyen. 2022. FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: System Demonstrations, pages 131–139, Hybrid: Seattle, Washington + Online. Association for Computational Linguistics.
Cite (Informal):
FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction (Nguyen et al., NAACL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.naacl-demo.14.pdf
Video:
 https://aclanthology.org/2022.naacl-demo.14.mp4
Code
 nlp-uoregon/famie
Data
CoNLL 2003