A Knowledge Graph Reasoning-Based Model for Computerized Adaptive Testing

Xinyi Qiu, Zhiyun Chen


Abstract
The significant of Computerized Adaptive Testing (CAT) is self-evident in contemporary Intelligent Tutoring Systems (ITSs) which aims to recommend suitable questions for students based on their knowledge state. In recent years, Graph Neural Networks (GNNs) and Reinforcement Learning (RL) methods have been increasingly applied to CAT. While these approaches have achieved empirical success, they still face limitations, such as inadequate handling of concept relevance when multiple concepts are involved and incomplete evaluation metrics. To address these issues, we propose a Knowledge Graph Reasoning-Based Model for CAT (KGCAT), which leverages the reasoning power of knowledge graphs (KGs) to capture the semantic and relational information between concepts and questions while focusing on reducing the noise caused by concepts with low relevance by utilizing mutual information. Additionally, a multi-objective reinforcement learning framework is employed to incorporate multiple evaluation objectives, further refining question selection and improving the overall effectiveness of CAT. Empirical evaluations conducted on three authentic educational datasets demonstrate that the proposed model outperforms existing methods in both accuracy and interpretability.
Anthology ID:
2025.coling-main.354
Volume:
Proceedings of the 31st International Conference on Computational Linguistics
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5295–5304
Language:
URL:
https://aclanthology.org/2025.coling-main.354/
DOI:
Bibkey:
Cite (ACL):
Xinyi Qiu and Zhiyun Chen. 2025. A Knowledge Graph Reasoning-Based Model for Computerized Adaptive Testing. In Proceedings of the 31st International Conference on Computational Linguistics, pages 5295–5304, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
A Knowledge Graph Reasoning-Based Model for Computerized Adaptive Testing (Qiu & Chen, COLING 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.coling-main.354.pdf