MetaAdapt: Domain Adaptive Few-Shot Misinformation Detection via Meta Learning

Zhenrui Yue, Huimin Zeng, Yang Zhang, Lanyu Shang, Dong Wang


Abstract
With emerging topics (e.g., COVID-19) on social media as a source for the spreading misinformation, overcoming the distributional shifts between the original training domain (i.e., source domain) and such target domains remains a non-trivial task for misinformation detection. This presents an elusive challenge for early-stage misinformation detection, where a good amount of data and annotations from the target domain is not available for training. To address the data scarcity issue, we propose MetaAdapt, a meta learning based approach for domain adaptive few-shot misinformation detection. MetaAdapt leverages limited target examples to provide feedback and guide the knowledge transfer from the source to the target domain (i.e., learn to adapt). In particular, we train the initial model with multiple source tasks and compute their similarity scores to the meta task. Based on the similarity scores, we rescale the meta gradients to adaptively learn from the source tasks. As such, MetaAdapt can learn how to adapt the misinformation detection model and exploit the source data for improved performance in the target domain. To demonstrate the efficiency and effectiveness of our method, we perform extensive experiments to compare MetaAdapt with state-of-the-art baselines and large language models (LLMs) such as LLaMA, where MetaAdapt achieves better performance in domain adaptive few-shot misinformation detection with substantially reduced parameters on real-world datasets.
Anthology ID:
2023.acl-long.286
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5223–5239
Language:
URL:
https://aclanthology.org/2023.acl-long.286
DOI:
10.18653/v1/2023.acl-long.286
Bibkey:
Cite (ACL):
Zhenrui Yue, Huimin Zeng, Yang Zhang, Lanyu Shang, and Dong Wang. 2023. MetaAdapt: Domain Adaptive Few-Shot Misinformation Detection via Meta Learning. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 5223–5239, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
MetaAdapt: Domain Adaptive Few-Shot Misinformation Detection via Meta Learning (Yue et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.286.pdf
Video:
 https://aclanthology.org/2023.acl-long.286.mp4