Probing the Think–Say Gap on Sensitive Concepts in Chinese and English Open LLMs

Yu-Chieh Wang, Lang-Ching Yeh, Guan-Yu Tseng, Shu-Kai Hsieh


Abstract
Open large language models (LLMs) trained under different alignment regimes treat politically sensitive concepts (freedom, democracy, human rights) differently, but outputs alone cannot separate alignment-induced suppression from pretraining culture: a model may withhold what it internally represents, or may simply reproduce the distribution it was trained on. We compare a Chinese-developed model (Qwen2.5-7B-Instruct) with an Englishdeveloped baseline (Gemma-3-12B-IT) on 360 bilingual, minimally contrastive items with a country-swap control (China vs. a matched democracy, Germany), using Natural Language Autoencoders to verbalize hidden states so that models with incommensurable representation spaces can be compared through text. Both models linearly encode a sensitive-vsneutral direction at the sentence-final state, beyond emotional salience and in both languages. Their behavior, however, diverges sharply: the Chinese model is China-specifically suppressive, justifying restrictions on political grounds far more for China than for a matched democracy, while the English model shows the reverse. The internal side remains inconclusive. Read before the model answers, the state does not support a reliable judgment of whether critical content is present, so we do not claim a think–say gap and identify extraction during generation as the decisive next test.
Anthology ID:
2026.oracle-main.20
Volume:
The Proceedings of the Workshop on Open Reasoning Across Cultures Languages (ORACLE)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Leonardo Ranaldi, Giulia Pucci, Federico Ranaldi, Marco Valentino, Alexandra Birch, Fabio Massimo Zanzotto
Venues:
ORACLE | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
304–315
Language:
URL:
https://aclanthology.org/2026.oracle-main.20/
DOI:
Bibkey:
Cite (ACL):
Yu-Chieh Wang, Lang-Ching Yeh, Guan-Yu Tseng, and Shu-Kai Hsieh. 2026. Probing the Think–Say Gap on Sensitive Concepts in Chinese and English Open LLMs. In The Proceedings of the Workshop on Open Reasoning Across Cultures Languages (ORACLE), pages 304–315, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Probing the Think–Say Gap on Sensitive Concepts in Chinese and English Open LLMs (Wang et al., ORACLE 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.oracle-main.20.pdf