Not All Tokens Are Equal: Syntax-Pattern Weighted Likelihood Difference Joint Detection for Neural-Training-Free AI-Generated Text Detection

Tianyu Guo, Shufeng Hao, JiaQi Li, Chongyang Shi


Abstract
Existing neural-training-free AI-Generated Text (AIGT) detectors usually aggregate token-level probability signals with uniform weights. However, this ignores an important linguistic regularity: human-written and AI-generated texts exhibit different Part-Of-Speech (POS) n-gram patterns, making certain tokens more informative than others. To address the limitations, we propose SWLD-Joint (Syntax-pattern Weighted Log-likelihood Difference Joint Detection), a calibration-based neural-training-free detector without gradient-based optimization or neural classifier fine-tuning. SWLD-Joint first estimates POS n-gram template weights from labeled calibration data and then combines them with a POS-trajectory calibration signal to focus on syntactically informative positions. Experiments on DetectRL, RAID, and HC3_Ext show robust gains under domain shift, generator mismatch, and adversarial perturbations. Ablations, parameter analysis, case studies, score distributions, and ROC curves verify the effectiveness of syntax-pattern weighting. Code and data will be released upon acceptance.
Anthology ID:
2026.findings-emnlp.1912
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
40743–40758
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1912/
DOI:
10.18653/2026.findings-emnlp.1912
Bibkey:
Cite (ACL):
Tianyu Guo, Shufeng Hao, JiaQi Li, and Chongyang Shi. 2026. Not All Tokens Are Equal: Syntax-Pattern Weighted Likelihood Difference Joint Detection for Neural-Training-Free AI-Generated Text Detection. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 40743–40758, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Not All Tokens Are Equal: Syntax-Pattern Weighted Likelihood Difference Joint Detection for Neural-Training-Free AI-Generated Text Detection (Guo et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1912.pdf