Rethinking Clustering as a Conversational Supervision Problem

Theo Rode, Aimee Co, Qingyang Zeng, Sanaya Gandhi, Ananya Purwar, Jonathan P. Chang, Masoud Hashemi, Khyati Mahajan, Filip Deryckere, Fabio Casati


Abstract
Clustering is often a process of trial and error: we apply different algorithms (such as k-means or hdbscan), apply different embeddings, try a dimensionality reduction, explore different values of K, inspect the result with the product manager, and repeat. When the data is large, even communicating and analyzing a single clustering becomes difficult.

We argue that the nature of clustering requires a fundamentally different approach. We posit that clustering is fundamentally a subjective and iterative process, and its central challenges are how to elicit the dimensions and nuances a user cares about, how to communicate a clustering effectively, and how to converge to an output of interest through efficient conversation. We reframe clustering as a conversational supervision problem. We formalize conversational clustering as a new task, derive evaluation metrics suited to it, and release an evaluation framework and reference implementation to seed further work.
Anthology ID:
2026.emnlp-main.1924
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
43823–43840
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1924/
DOI:
Bibkey:
Cite (ACL):
Theo Rode, Aimee Co, Qingyang Zeng, Sanaya Gandhi, Ananya Purwar, Jonathan P. Chang, Masoud Hashemi, Khyati Mahajan, Filip Deryckere, and Fabio Casati. 2026. Rethinking Clustering as a Conversational Supervision Problem. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 43823–43840, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Rethinking Clustering as a Conversational Supervision Problem (Rode et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1924.pdf