Data Augmentation with Dual Training for Offensive Span Detection

Nasim Nouri


Abstract
Recognizing offensive text is an important requirement for every content management system, especially for social networks. While the majority of the prior work formulate this problem as text classification, i.e., if a text excerpt is offensive or not, in this work we propose a novel model for offensive span detection (OSD), whose goal is to identify the spans responsible for the offensive tone of the text. One of the challenges to train a model for this novel setting is the lack of enough training data. To address this limitation, in this work we propose a novel method in which the large-scale pre-trained language model GPT-2 is employed to generate synthetic training data for OSD. In particular, we propose to train the GPT-2 model in a dual-training setting using the REINFORCE algorithm to generate in-domain, natural and diverse training samples. Extensive experiments on the benchmark dataset for OSD reveal the effectiveness of the proposed method.
Anthology ID:
2022.naacl-main.185
Volume:
Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Month:
July
Year:
2022
Address:
Seattle, United States
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2569–2575
Language:
URL:
https://aclanthology.org/2022.naacl-main.185
DOI:
10.18653/v1/2022.naacl-main.185
Bibkey:
Cite (ACL):
Nasim Nouri. 2022. Data Augmentation with Dual Training for Offensive Span Detection. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 2569–2575, Seattle, United States. Association for Computational Linguistics.
Cite (Informal):
Data Augmentation with Dual Training for Offensive Span Detection (Nouri, NAACL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.naacl-main.185.pdf