A User-Centered, Interactive, Human-in-the-Loop Topic Modelling System

Zheng Fang, Lama Alqazlan, Du Liu, Yulan He, Rob Procter


Abstract
Human-in-the-loop topic modelling incorporates users’ knowledge into the modelling process, enabling them to refine the model iteratively. Recent research has demonstrated the value of user feedback, but there are still issues to consider, such as the difficulty in tracking changes, comparing different models and the lack of evaluation based on real-world examples of use. We developed a novel, interactive human-in-the-loop topic modeling system with a user-friendly interface that enables users compare and record every step they take, and a novel topic words suggestion feature to help users provide feedback that is faithful to the ground truth. Our system also supports not only what traditional topic models can do, i.e., learning the topics from the whole corpus, but also targeted topic modelling, i.e., learning topics for specific aspects of the corpus. In this article, we provide an overview of the system and present the results of a series of user studies designed to assess the value of the system in progressively more realistic applications of topic modelling.
Anthology ID:
2023.eacl-main.37
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
505–522
Language:
URL:
https://aclanthology.org/2023.eacl-main.37
DOI:
10.18653/v1/2023.eacl-main.37
Bibkey:
Cite (ACL):
Zheng Fang, Lama Alqazlan, Du Liu, Yulan He, and Rob Procter. 2023. A User-Centered, Interactive, Human-in-the-Loop Topic Modelling System. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 505–522, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
A User-Centered, Interactive, Human-in-the-Loop Topic Modelling System (Fang et al., EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-main.37.pdf
Video:
 https://aclanthology.org/2023.eacl-main.37.mp4