TaxoAgent: Utility-Aligned Policy Optimization for Hierarchical Semantic Classification

Zhiming Lin, Yihao Zhong, Liwei Hou, Saisai Hu, ShaoYan He, Chen Rongru, Xuan Yang, Siyue Liu


Abstract
Hierarchical semantic classification is essential for taxonomy-driven applications, yet existing classifiers often optimize flat label likelihoods and therefore weakly control parent-child validity, semantic error severity, coarse-to-fine coherence, and out-of-scope rejection. This paper aims to align LLM-based classifiers with the full structured utility of hierarchical prediction rather than treating taxonomy labels as independent targets. We propose TaxoAgent, a utility-aligned policy optimization framework that formulates taxonomy prediction as a verified parent-to-child decision trajectory. Given an input, TaxoAgent first predicts coarse parent labels, expands them into fine-grained child decisions, and verifies the resulting trajectory with a composite utility that jointly measures outcome correctness, hierarchy consistency, semantic proximity, and trajectory coherence; group-relative policy optimization then reinforces high-utility trajectories over low-utility alternatives. Across IOS-APP-ZH, Google-APP-EN, RCV1, WOS, and CLINC150, TaxoAgent consistently improves Micro-F1 and Macro-F1, reduces hierarchy inconsistency, strengthens long-tail classification, and improves OOS-F1 by up to 3.68 points over the strongest prior baseline. These results show that treating taxonomies as structured decision spaces offers a practical and extensible path toward more reliable, adaptable, and utility-aware semantic classifiers.
Anthology ID:
2026.emnlp-main.1006
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
23149–23171
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1006/
DOI:
Bibkey:
Cite (ACL):
Zhiming Lin, Yihao Zhong, Liwei Hou, Saisai Hu, ShaoYan He, Chen Rongru, Xuan Yang, and Siyue Liu. 2026. TaxoAgent: Utility-Aligned Policy Optimization for Hierarchical Semantic Classification. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 23149–23171, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
TaxoAgent: Utility-Aligned Policy Optimization for Hierarchical Semantic Classification (Lin et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1006.pdf