Curriculum Learning for Graph Neural Networks: A Multiview Competence-based Approach

Nidhi Vakil, Hadi Amiri


Abstract
A curriculum is a planned sequence of learning materials and an effective one can make learning efficient and effective for both humans and machines. Recent studies developed effective data-driven curriculum learning approaches for training graph neural networks in language applications. However, existing curriculum learning approaches often employ a single criterion of difficulty in their training paradigms. In this paper, we propose a new perspective on curriculum learning by introducing a novel approach that builds on graph complexity formalisms (as difficulty criteria) and model competence during training. The model consists of a scheduling scheme which derives effective curricula by accounting for different views of sample difficulty and model competence during training. The proposed solution advances existing research in curriculum learning for graph neural networks with the ability to incorporate a fine-grained spectrum of graph difficulty criteria in their training paradigms. Experimental results on real-world link prediction and node classification tasks illustrate the effectiveness of the proposed approach.
Anthology ID:
2023.acl-long.389
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7036–7051
Language:
URL:
https://aclanthology.org/2023.acl-long.389
DOI:
10.18653/v1/2023.acl-long.389
Bibkey:
Cite (ACL):
Nidhi Vakil and Hadi Amiri. 2023. Curriculum Learning for Graph Neural Networks: A Multiview Competence-based Approach. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7036–7051, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Curriculum Learning for Graph Neural Networks: A Multiview Competence-based Approach (Vakil & Amiri, ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.389.pdf
Video:
 https://aclanthology.org/2023.acl-long.389.mp4