A Manifold-Aware Topic Modeling Approach via Rank-Based Prototypes

Thiago César Castilho Almeida, Daniel Pedronette


Abstract
Recent topic models leverage pretrained embeddings, but neural architectures produce latent representations without grounding in specific texts, and clustering-based pipelines assign representative documents only post hoc, relying on absolute distances distorted by hubness and anisotropy in high-dimensional spaces. We introduce MARETopic, a training-free framework that casts topic discovery as rank-based prototype selection. After projecting embeddings onto a low-dimensional manifold, MARETopic builds ranked lists encoding ordinal neighborhood structure. A greedy algorithm selects exactly K exemplar documents, real corpus texts, whose neighborhoods cover the corpus. Two variants share this criterion. MARETopic_Corr scores candidates with a query performance predictor and a rank correlation measure, leading Purity and NMI on the two benchmarks with the most categories, ahead of both neural and clustering-based topic models. MARETopic_Diff scores them with a rank-based diffusion matrix, needs neither measure, and runs 1.7 to 1.9 times faster. Without a single gradient update, MARETopic leads topic coherence on two of three datasets. A novel inter-topic Maximal Marginal Relevance step raises vocabulary diversity at little cost in coherence. Our code is available at https://github.com/thcastilho/maretopic.
Anthology ID:
2026.emnlp-main.1478
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
33789–33803
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1478/
DOI:
Bibkey:
Cite (ACL):
Thiago César Castilho Almeida and Daniel Pedronette. 2026. A Manifold-Aware Topic Modeling Approach via Rank-Based Prototypes. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 33789–33803, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
A Manifold-Aware Topic Modeling Approach via Rank-Based Prototypes (Almeida & Pedronette, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1478.pdf