The Sycophancy Matrix: Measuring and Steering Ethos-Driven Sycophancy Across Languages and Cultures

Gabriele Maraia, Micol Menchi, Alessia Fidelibus, Luana Magnante, Irene Orlando, Gaia Palazzi, Fabio Massimo Zanzotto


Abstract
Large Language Models (LLMs) exhibit sycophancy, aligning with user assertions even when they conflict with facts. We frame sycophancy as a sociolinguistic phenomenon, disentangling explicit authority (credentials) from implicit authority (linguistic register), and adopt the Sycophancy Matrix, an adversarial evaluation framework that isolates these variables. Evaluating open-weight models on a controlled TruthfulQA subset across English, Spanish, and Portuguese cultural variants, we find that models exhibit statistically significant cultural variation and show stable sycophancy fingerprints intrinsic to model family, independent of language. We then recast the Matrix as a defence framework, evaluating two activation steering methods, CAA and NoLAI, on whether methods trained on English transfer to Italian, Spanish, and Portuguese. Both methods reduce the Weighted Sycophancy Rate across all four attack styles, and the defence generalises cross-lingually: sociolinguistic stance, its emergence, and its correction are encoded in a largely language-agnostic geometric space.
Anthology ID:
2026.oracle-main.2
Volume:
The Proceedings of the Workshop on Open Reasoning Across Cultures Languages (ORACLE)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Leonardo Ranaldi, Giulia Pucci, Federico Ranaldi, Marco Valentino, Alexandra Birch, Fabio Massimo Zanzotto
Venues:
ORACLE | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
22–39
Language:
URL:
https://aclanthology.org/2026.oracle-main.2/
DOI:
Bibkey:
Cite (ACL):
Gabriele Maraia, Micol Menchi, Alessia Fidelibus, Luana Magnante, Irene Orlando, Gaia Palazzi, and Fabio Massimo Zanzotto. 2026. The Sycophancy Matrix: Measuring and Steering Ethos-Driven Sycophancy Across Languages and Cultures. In The Proceedings of the Workshop on Open Reasoning Across Cultures Languages (ORACLE), pages 22–39, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
The Sycophancy Matrix: Measuring and Steering Ethos-Driven Sycophancy Across Languages and Cultures (Maraia et al., ORACLE 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.oracle-main.2.pdf