Reevaluating Argument Component Extraction in Low Resource Settings

Anirudh Joshi, Timothy Baldwin, Richard Sinnott, Cecile Paris


Abstract
Argument component extraction is a challenging and complex high-level semantic extraction task. As such, it is both expensive to annotate (meaning training data is limited and low-resource by nature), and hard for current-generation deep learning methods to model. In this paper, we reevaluate the performance of state-of-the-art approaches in both single- and multi-task learning settings using combinations of character-level, GloVe, ELMo, and BERT encodings using standard BiLSTM-CRF encoders. We use evaluation metrics that are more consistent with evaluation practice in named entity recognition to understand how well current baselines address this challenge and compare their performance to lower-level semantic tasks such as CoNLL named entity recognition. We find that performance utilizing various pre-trained representations and training methodologies often leaves a lot to be desired as it currently stands, and suggest future pathways for improvement.
Anthology ID:
D19-6124
Volume:
Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019)
Month:
November
Year:
2019
Address:
Hong Kong, China
Editors:
Colin Cherry, Greg Durrett, George Foster, Reza Haffari, Shahram Khadivi, Nanyun Peng, Xiang Ren, Swabha Swayamdipta
Venue:
WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
219–224
Language:
URL:
https://aclanthology.org/D19-6124
DOI:
10.18653/v1/D19-6124
Bibkey:
Cite (ACL):
Anirudh Joshi, Timothy Baldwin, Richard Sinnott, and Cecile Paris. 2019. Reevaluating Argument Component Extraction in Low Resource Settings. In Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019), pages 219–224, Hong Kong, China. Association for Computational Linguistics.
Cite (Informal):
Reevaluating Argument Component Extraction in Low Resource Settings (Joshi et al., 2019)
Copy Citation:
PDF:
https://aclanthology.org/D19-6124.pdf