NotAI.AI: An Interactive Explainable System for AI-Generated Text Detection

Oleksandr Marchenko Breneur, Adelaide Danilov, Aria Nourbakhsh, Salima Lamsiyah


Abstract
We present NotAI.AI, an explainable AI-generated text detection system. Instead of returning only a binary label or confidence score, the system shows which signals influenced the prediction and lets users inspect an attribution-based sensitivity estimate obtained by subtracting selected local contributions. NotAI.AI combines sentence-level conditional probability curvature, a neural detector score, and interpretable stylometric and readability features in an XGBoost meta-classifier. It explains predictions with TreeSHAP feature contributions and can turn the resulting evidence into a concise natural-language explanation. We evaluate the system on a category-balanced subset of RAID containing human-written, clean AI-generated, and attacked AI-generated texts. The full model outperforms variants based on individual feature families, reaching 0.9685 F1 on the held-out within-subset test split. In an automatic evaluation, two model judges rate 94.5-98.6% of generated explanations as faithful to the supplied detector evidence. The web interface (https://notai-ai.vercel.app), source code (https://github.com/Oleksandr-MB/EMNLP2026DEMO_NotAI.AI), and demonstration video (https://youtu.be/l8Nk8kdBTHQ) are publicly available.
Anthology ID:
2026.emnlp-demos.67
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Sweta Agrawal, Alberto Abad
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
706–716
Language:
URL:
https://aclanthology.org/2026.emnlp-demos.67/
DOI:
Bibkey:
Cite (ACL):
Oleksandr Marchenko Breneur, Adelaide Danilov, Aria Nourbakhsh, and Salima Lamsiyah. 2026. NotAI.AI: An Interactive Explainable System for AI-Generated Text Detection. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 706–716, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
NotAI.AI: An Interactive Explainable System for AI-Generated Text Detection (Breneur et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-demos.67.pdf