TaxCE : A Framework for Automated Taxonomy Construction and Evaluation at Scale

Sandeep Sricharan Mukku, Albert Aristotle Nanda, Rohit Pyati


Abstract
Organizing unstructured feedback text into hierarchical taxonomy is a fundamental challenge in NLP, particularly in domains where feedback arrives at massive scale in varied forms such as reviews, transcripts, and surveys. Existing approaches either produce shallow hierarchies, neglect long-tail topics, or lack rigorous evaluation frameworks. We present TaxCE, a fully automated framework that constructs multi-level hierarchical taxonomies from raw text through progressive condensation of corpus content into actionable segments, deduplicated semantic units, and granular topics with definitions, which are then organized bottom-up into a hierarchy with corpus-groundedness. We also introduce three corpus-grounded evaluation metrics, Exclusivity, Exhaustivity, and Granularity (EEG), and integrate them into a metrics-in-the-loop iterative refinement mechanism that diagnoses deficiencies and applies targeted corrections until convergence. Extensive experiments demonstrate that TaxCE consistently outperforms existing baselines spanning classical topic models, neural methods, and LLM-based approaches, with average improvements of 11.8, 20.5, and 15.7 percentage points in exclusivity, exhaustivity, and granularity respectively over the strongest baseline. Human evaluation further confirms superior taxonomy quality, actionability, and navigability.
Anthology ID:
2026.emnlp-industry.76
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pepa Atanasova, Gholamreza Haffari, Minghan Wang
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1280–1301
Language:
URL:
https://aclanthology.org/2026.emnlp-industry.76/
DOI:
Bibkey:
Cite (ACL):
Sandeep Sricharan Mukku, Albert Aristotle Nanda, and Rohit Pyati. 2026. TaxCE : A Framework for Automated Taxonomy Construction and Evaluation at Scale. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 1280–1301, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
TaxCE : A Framework for Automated Taxonomy Construction and Evaluation at Scale (Mukku et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-industry.76.pdf