QUILT: Query–User Interaction Linguistic Taxonomy

Yuyang Dai


Abstract
Large language models are used by people with very different expertise levels, but existing work studies what users ask more than who is asking. We introduce QUILT (Query User Interaction Linguistic Taxonomy) , a two-dimensional framework that jointly characterizes LLM conversations by task type and user expertise level. Applying QUILT to 3,000 WildChat dialogues, we construct the first large-scale corpus linking expertise level to task-level interaction patterns in open-ended LLM conversations. Corpus analysis reveals clear expertise-dependent asymmetries: debugging queries are strongly associated with expert users, novice users rarely engage in reasoning-intensive tasks, and expert queries are substantially longer across all task types. These patterns are statistically significant and recoverable by automatic classifiers, indicating that expertise differences are systematically reflected in conversational language. Together, QUILT and the QUILT Corpus provide an empirical foundation for studying user heterogeneity in LLM interaction and for developing expertise-aware response strategies.
Anthology ID:
2026.aacl-long.138
Volume:
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venues:
AACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3018–3035
Language:
URL:
https://aclanthology.org/2026.aacl-long.138/
DOI:
Bibkey:
Cite (ACL):
Yuyang Dai. 2026. QUILT: Query–User Interaction Linguistic Taxonomy. In Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 3018–3035, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
QUILT: Query–User Interaction Linguistic Taxonomy (Dai, AACL-IJCNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aacl-long.138.pdf