End-to-end Adversarial Sample Generation for Data Augmentation

Tianyuan Liu, Yuqing Sun


Abstract
Adversarial samples pose a significant challenge to neural inference models. In this paper, we propose a novel enhancing approach A3 for the robustness of the neural NLP models, which combines the adversarial training and data augmentation. We propose an adversarial sample generator that consists of a conditioned paraphrasing model and a condition generator. The latter aims to generate conditions which guides the paraphrasing model to generate adversarial samples. A pretrained discriminator is introduced to help the adversarial sample generator adapt to the data characteristics for different tasks. We adopt a weighted loss to incorporate the generated adversarial samples with the original samples for augmented training. Compared to existing methods, our approach is much efficient since the generation process is independent to the target model and the generated samples are reusable for different models. Experimental results on several tasks show that our approach improves the overall performance of the trained model. Specially, the enhanced model is robust for various attacking techniques.
Anthology ID:
2023.findings-emnlp.760
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2023
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
11359–11368
Language:
URL:
https://aclanthology.org/2023.findings-emnlp.760
DOI:
10.18653/v1/2023.findings-emnlp.760
Bibkey:
Cite (ACL):
Tianyuan Liu and Yuqing Sun. 2023. End-to-end Adversarial Sample Generation for Data Augmentation. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 11359–11368, Singapore. Association for Computational Linguistics.
Cite (Informal):
End-to-end Adversarial Sample Generation for Data Augmentation (Liu & Sun, Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-emnlp.760.pdf