TraceMIA: Interpretable Membership Inference Attack via Lexical Patterns in Reasoning Traces

Bo Zhang, Yongtang Wu, Ning Liu, Jun Zhang, Zhunchen Luo, Yunbo Cao, Xiaoying Bai, Guotong Geng, Zhong Wang


Abstract
As large language models (LLMs) increasingly rely on web-scale corpora, membership inference attacks (MIAs) have become essential tools for auditing unauthorized data usage. However, traditional token-level MIAs fail to generalize to large reasoning models (LRMs) due to data distribution shifts introduced during fine-tuning. While recent studies address this by encoding reasoning traces into latent semantic spaces, they sacrifice the interpretability strictly required for real-world copyright verification. In this paper, we demonstrate that an LRM’s internal memory states are explicitly leaked through its stylistic word choices. Our analysis reveals a distinct lexical dichotomy: non-member traces tend toward a "guessing-like" tone, whereas member traces exhibit a "remember-like" style. Motivated by this interesting phenomenon, we propose TraceMIA, an interpretable MIA framework that audits training corpora by computing membership scores based on the relative frequencies of discriminative cue words. Extensive empirical evaluations across representative LRMs and diverse datasets demonstrate that TraceMIA achieves robust detection efficacy while providing the transparent, human-readable evidence critical for practical auditing scenarios.
Anthology ID:
2026.emnlp-main.532
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
12273–12289
Language:
URL:
https://aclanthology.org/2026.emnlp-main.532/
DOI:
Bibkey:
Cite (ACL):
Bo Zhang, Yongtang Wu, Ning Liu, Jun Zhang, Zhunchen Luo, Yunbo Cao, Xiaoying Bai, Guotong Geng, and Zhong Wang. 2026. TraceMIA: Interpretable Membership Inference Attack via Lexical Patterns in Reasoning Traces. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 12273–12289, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
TraceMIA: Interpretable Membership Inference Attack via Lexical Patterns in Reasoning Traces (Zhang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.532.pdf