Prompt as Stratified Interface: Decomposing Label-Mediated Effects in Chinese-English NLI

Hua Zhao, Zhiqing Yang, Michelle Mingyue Gu


Abstract
Multilingual prompting studies often compare English instructions with target-language instructions. For classification, however, this comparison bundles more than instruction wording: prompts also define categories, name them, bind them to answer symbols, and specify an output form. We study this label interface in Chinese-English XNLI with examples, gold labels, and decoding fixed. Under ordinary semantic-label prompting, Qwen3-8B shows large CN-interface gains on both input sides, larger Qwen3 models are near zero, and Llama3.1-70B shows a smaller gain concentrated on Chinese inputs. Removing visible category names with all six A/B/C permutations nearly eliminates the Qwen3-8B gains, while Llama-3.1-70B retains a Chinese-input residual. Restoring names inside A/B/C options improves accuracy and reduces the largest mapping instabilities, but signed contrasts remain model-specific. Direct semantic-label output adds only small gains once category names are visible. A targeted 2 × 2 follow-up associates the Llama-3.1-70B Chinese-input residual primarily with procedural-block language on average, moderated by relation-definition language; alternate-label and crossed-label checks further show that exact label wording and language can shrink or reverse the signed contrast. We use semantic label anchoring only as descriptive shorthand. The result is a scoped measurementvalidity finding for Chinese-English XNLI and the tested prompt family, not a claim of invariance across language pairs or prompt paraphrases.
Anthology ID:
2026.oracle-main.35
Volume:
The Proceedings of the Workshop on Open Reasoning Across Cultures Languages (ORACLE)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Leonardo Ranaldi, Giulia Pucci, Federico Ranaldi, Marco Valentino, Alexandra Birch, Fabio Massimo Zanzotto
Venues:
ORACLE | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
515–533
Language:
URL:
https://aclanthology.org/2026.oracle-main.35/
DOI:
Bibkey:
Cite (ACL):
Hua Zhao, Zhiqing Yang, and Michelle Mingyue Gu. 2026. Prompt as Stratified Interface: Decomposing Label-Mediated Effects in Chinese-English NLI. In The Proceedings of the Workshop on Open Reasoning Across Cultures Languages (ORACLE), pages 515–533, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Prompt as Stratified Interface: Decomposing Label-Mediated Effects in Chinese-English NLI (Zhao et al., ORACLE 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.oracle-main.35.pdf