Q-CAT: A Non-Parametric Query Filtering System for Prohibited Content in Dynamic Enterprise Environments

Juheon Kang, Eunkyung Choi, Hongseok Oh, Hyunseo Shin, JuYoun Son, Yunjin Bae, Wonseok Hwang


Abstract
Large Language Models (LLMs) are increasingly being adopted in enterprise environments, where employees may intentionally or accidentally submit prompts containing information that could cause legal or economic harm if leaked. Organizations may define categories of information (policies) that are prohibited from being submitted to commercial LLMs, but these definitions can vary between companies and evolve over time. This variability makes parametric classifiers less practical, as they require retraining whenever policies change. Here, we present Q-CAT, a non-parametric policy enforcement system that classifies user queries based on given categories of information that can change dynamically. The system operates by matching embedded user queries to synthetically generated queries in the database. This design enables low-cost policy updates through simple database modification, without retraining, while maintaining low latency. A comparison with strong prompt-based LLM baselines shows that Q-CAT delivers competitive performance in static environments, while offering practical advantages in dynamic policy settings, where policies change and the Query Pool can be updated from logs. Moreover, Q-CAT is up to two orders of magnitude faster than comparable-performance baselines in our experimental setup.
Anthology ID:
2026.emnlp-main.1221
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
27870–27891
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1221/
DOI:
Bibkey:
Cite (ACL):
Juheon Kang, Eunkyung Choi, Hongseok Oh, Hyunseo Shin, JuYoun Son, Yunjin Bae, and Wonseok Hwang. 2026. Q-CAT: A Non-Parametric Query Filtering System for Prohibited Content in Dynamic Enterprise Environments. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 27870–27891, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Q-CAT: A Non-Parametric Query Filtering System for Prohibited Content in Dynamic Enterprise Environments (Kang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1221.pdf