PingAnTech at SMM4H task1: Multiple pre-trained model approaches for Adverse Drug Reactions

Xi Liu, Han Zhou, Chang Su


Abstract
This paper describes the solution for the Social Media Mining for Health (SMM4H) 2022 Shared Task. We participated in Task1a., Task1b. and Task1c. To solve the problem of the presence of Twitter data, we used a pre-trained language model. We used training strategies that involved: adversarial training, head layer weighted fusion, etc., to improve the performance of the model. The experimental results show the effectiveness of our designed system. For task 1a, the system achieved an F1 score of 0.68; for task 1b Overlapping F1 score of 0.65 and a Strict F1 score of 0.49. Task 1c yields Overlapping F1 and Strict F1 scores of 0.36 and 0.30, respectively.
Anthology ID:
2022.smm4h-1.2
Volume:
Proceedings of The Seventh Workshop on Social Media Mining for Health Applications, Workshop & Shared Task
Month:
October
Year:
2022
Address:
Gyeongju, Republic of Korea
Editors:
Graciela Gonzalez-Hernandez, Davy Weissenbacher
Venue:
SMM4H
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4–6
Language:
URL:
https://aclanthology.org/2022.smm4h-1.2
DOI:
Bibkey:
Cite (ACL):
Xi Liu, Han Zhou, and Chang Su. 2022. PingAnTech at SMM4H task1: Multiple pre-trained model approaches for Adverse Drug Reactions. In Proceedings of The Seventh Workshop on Social Media Mining for Health Applications, Workshop & Shared Task, pages 4–6, Gyeongju, Republic of Korea. Association for Computational Linguistics.
Cite (Informal):
PingAnTech at SMM4H task1: Multiple pre-trained model approaches for Adverse Drug Reactions (Liu et al., SMM4H 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.smm4h-1.2.pdf