Syntactic Complexity Convergence in Dialogue: Analysis of the Phenomenon and Application to LLM Detection

Yu Wang, Yanran Chen, Yifan Wang, Steffen Eger, Hendrik Buschmeier


Abstract
We revisit the under-explored phenomenon of syntactic complexity convergence in dialogue. Extending prior topic-level analyses to full conversations, we examine five human-human datasets and a set of human-LLM dialogues. We integrate and evaluate a multidimensional set of syntactic complexity metrics to quantify structural variation in dialogue. Our analyses reveal robust syntactic complexity convergence across human-human datasets, especially in task-oriented interactions, and statistical tests confirm that these effects are not due to chance. In contrast, human-LLM dialogues show no significant convergence under individual metrics; however, linear-CKA uncovers a distinct cross-metric convergence pattern. Motivated by these differences, we use syntactic complexity as a feature for detecting LLM-involved dialogue, achieving 96% accuracy. Our classification results demonstrate its potential without relying on likelihood-based signals such as surprisal, which require a language model as the estimator.
Anthology ID:
2026.emnlp-main.1239
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
28244–28269
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1239/
DOI:
Bibkey:
Cite (ACL):
Yu Wang, Yanran Chen, Yifan Wang, Steffen Eger, and Hendrik Buschmeier. 2026. Syntactic Complexity Convergence in Dialogue: Analysis of the Phenomenon and Application to LLM Detection. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 28244–28269, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Syntactic Complexity Convergence in Dialogue: Analysis of the Phenomenon and Application to LLM Detection (Wang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1239.pdf