TaxoCritic: Exploring Credit Assignment in Taxonomy Induction with Multi-Critic Reinforcement Learning

Injy Sarhan, Bendegúz Toth, Pablo Mosteiro, Shihan Wang


Abstract
Taxonomies can serve as a vital foundation for several downstream tasks such as information retrieval and question answering, yet manual construction limits coverage and full potential. Automatic taxonomy induction, particularly using deep Reinforcement Learning (RL), is underexplored in Natural Language Processing (NLP). To address this gap, we present TaxoCritic, a novel approach that leverages deep multi-critic RL agents for taxonomy induction while incorporating credit assignment mechanisms. Our system uniquely assesses different sub-actions within the induction process, providing a granular analysis that aids in the precise attribution of credit and blame. We evaluate the effectiveness of multi-critic algorithms in experiments regarding both accuracy and robustness performance in edge identification. By providing a detailed comparison with state-of-the-art models and highlighting the strengths and limitations of our method, we aim to contribute to the ongoing
Anthology ID:
2024.dlnld-1.2
Volume:
Proceedings of the Workshop on Deep Learning and Linked Data (DLnLD) @ LREC-COLING 2024
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Gilles Sérasset, Hugo Gonçalo Oliveira, Giedre Valunaite Oleskeviciene
Venues:
DLnLD | WS
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
14–30
Language:
URL:
https://aclanthology.org/2024.dlnld-1.2
DOI:
Bibkey:
Cite (ACL):
Injy Sarhan, Bendegúz Toth, Pablo Mosteiro, and Shihan Wang. 2024. TaxoCritic: Exploring Credit Assignment in Taxonomy Induction with Multi-Critic Reinforcement Learning. In Proceedings of the Workshop on Deep Learning and Linked Data (DLnLD) @ LREC-COLING 2024, pages 14–30, Torino, Italia. ELRA and ICCL.
Cite (Informal):
TaxoCritic: Exploring Credit Assignment in Taxonomy Induction with Multi-Critic Reinforcement Learning (Sarhan et al., DLnLD-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.dlnld-1.2.pdf