Vendi Clustering for Diversity-Preserving Topic Reduction

Sean Kim, Adji Bousso Dieng


Abstract
Embedding-based topic models such as BERTopic routinely produce hundreds of fine-grained, overlapping topics that must be reduced before downstream use. Existing approaches couple reduction with outlier rejection, rely on local geometric linkage, or use costly and stochastic LLM prompting. We introduce Vendi Clustering (VC), a topic reduction method that reframes the problem as global diversity-preserving compression: at each step, VC selects the merge that induces the smallest loss in the Vendi Score, a spectral measure of diversity. A naive implementation of this global criterion is prohibitive at O(n6); we derive algebraic update rules at order q = 2 that evaluate each candidate merge in O(1) via cached row-square sums and a lookahead Gram matrix, reducing total complexity to a tractable O(n3). On 20 Newsgroups and AG News, VC outperforms standard reduction baselines on coherence and diversity, surpasses LLM-prompted reduction on the majority of metrics against both an open-weight model and a frontier API model, with topic diversity gains of up to 35% while running over 40 × faster.
Anthology ID:
2026.findings-emnlp.1364
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
28964–28980
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1364/
DOI:
Bibkey:
Cite (ACL):
Sean Kim and Adji Bousso Dieng. 2026. Vendi Clustering for Diversity-Preserving Topic Reduction. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 28964–28980, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Vendi Clustering for Diversity-Preserving Topic Reduction (Kim & Dieng, Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1364.pdf