Generative Adversarial Networks based on Mixed-Attentions for Citation Intent Classification in Scientific Publications

Yuh-Shyang Wang, Chao-Yi Chen, Lung-Hao Lee


Abstract
We propose the mixed-attention-based Generative Adversarial Network (named maGAN), and apply it for citation intent classification in scientific publication. We select domain-specific training data, propose a mixed-attention mechanism, and employ generative adversarial network architecture for pre-training language model and fine-tuning to the downstream multi-class classification task. Experiments were conducted on the SciCite datasets to compare model performance. Our proposed maGAN model achieved the best Macro-F1 of 0.8532.
Anthology ID:
2021.rocling-1.36
Volume:
Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing (ROCLING 2021)
Month:
October
Year:
2021
Address:
Taoyuan, Taiwan
Editors:
Lung-Hao Lee, Chia-Hui Chang, Kuan-Yu Chen
Venue:
ROCLING
SIG:
Publisher:
The Association for Computational Linguistics and Chinese Language Processing (ACLCLP)
Note:
Pages:
280–285
Language:
URL:
https://aclanthology.org/2021.rocling-1.36
DOI:
Bibkey:
Cite (ACL):
Yuh-Shyang Wang, Chao-Yi Chen, and Lung-Hao Lee. 2021. Generative Adversarial Networks based on Mixed-Attentions for Citation Intent Classification in Scientific Publications. In Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing (ROCLING 2021), pages 280–285, Taoyuan, Taiwan. The Association for Computational Linguistics and Chinese Language Processing (ACLCLP).
Cite (Informal):
Generative Adversarial Networks based on Mixed-Attentions for Citation Intent Classification in Scientific Publications (Wang et al., ROCLING 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.rocling-1.36.pdf
Data
S2ORCSciCiteSemantic Scholar