DeepBlueAI at PragTag-2023:Ensemble-based Text Classification Approaches under Limited Data Resources

Zhipeng Luo, Jiahui Wang, Yihao Guo


Abstract
Due to the scarcity of review data and the high annotation cost, in this paper, we primarily delve into the fine-tuning of pretrained models using limited data. To enhance the robustness of the model, we employ adversarial training techniques. By introducing subtle perturbations, we compel the model to better cope with adversarial attacks, thereby increasing the stability of the model in input data. We utilize pooling techniques to aid the model in extracting critical information, reducing computational complexity, and improving the model’s generalization capability. Experimental results demonstrate the effectiveness of our proposed approach on a review paper dataset with limited data volume.
Anthology ID:
2023.argmining-1.23
Volume:
Proceedings of the 10th Workshop on Argument Mining
Month:
December
Year:
2023
Address:
Singapore
Editors:
Milad Alshomary, Chung-Chi Chen, Smaranda Muresan, Joonsuk Park, Julia Romberg
Venues:
ArgMining | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
202–206
Language:
URL:
https://aclanthology.org/2023.argmining-1.23
DOI:
10.18653/v1/2023.argmining-1.23
Bibkey:
Cite (ACL):
Zhipeng Luo, Jiahui Wang, and Yihao Guo. 2023. DeepBlueAI at PragTag-2023:Ensemble-based Text Classification Approaches under Limited Data Resources. In Proceedings of the 10th Workshop on Argument Mining, pages 202–206, Singapore. Association for Computational Linguistics.
Cite (Informal):
DeepBlueAI at PragTag-2023:Ensemble-based Text Classification Approaches under Limited Data Resources (Luo et al., ArgMining-WS 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.argmining-1.23.pdf
Video:
 https://aclanthology.org/2023.argmining-1.23.mp4