PeerDA: Data Augmentation via Modeling Peer Relation for Span Identification Tasks

Weiwen Xu, Xin Li, Yang Deng, Wai Lam, Lidong Bing


Abstract
Span identification aims at identifying specific text spans from text input and classifying them into pre-defined categories. Different from previous works that merely leverage the Subordinate (SUB) relation (i.e. if a span is an instance of a certain category) to train models, this paper for the first time explores the Peer (PR) relation, which indicates that two spans are instances of the same category and share similar features. Specifically, a novel Peer Data Augmentation (PeerDA) approach is proposed which employs span pairs with the PR relation as the augmentation data for training. PeerDA has two unique advantages: (1) There are a large number of PR span pairs for augmenting the training data. (2) The augmented data can prevent the trained model from over-fitting the superficial span-category mapping by pushing the model to leverage the span semantics. Experimental results on ten datasets over four diverse tasks across seven domains demonstrate the effectiveness of PeerDA. Notably, PeerDA achieves state-of-the-art results on six of them.
Anthology ID:
2023.acl-long.484
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
8681–8699
Language:
URL:
https://aclanthology.org/2023.acl-long.484
DOI:
10.18653/v1/2023.acl-long.484
Bibkey:
Cite (ACL):
Weiwen Xu, Xin Li, Yang Deng, Wai Lam, and Lidong Bing. 2023. PeerDA: Data Augmentation via Modeling Peer Relation for Span Identification Tasks. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 8681–8699, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
PeerDA: Data Augmentation via Modeling Peer Relation for Span Identification Tasks (Xu et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.484.pdf
Video:
 https://aclanthology.org/2023.acl-long.484.mp4