S HARING B EYOND D ECISION: Deep Collaboration between Large Language Models via Representation Ensemble

Yichong Huang, Xiaocheng Feng, Jinlan Fu, Xiachong Feng, Baohang Li, Zekai Ye, Libo Qin, Hao Fei, See-Kiong Ng, Bing Qin


Abstract
Large Language Models (LLMs) exhibit unique strengths arising from differences in model architecture, training data, and strategies. Ensemble learning has been explored to leverage these complementary strengths through decision-level sharing (i.e.,Decision Ensemble), which combines the predictions from multiple LLMs. However, such methods integrate only shallow decisions and overlook the exchange of deeper levels of information within the internal representations of LLMs, such as problem understanding, world knowledge, and latent reasoning patterns. In this work, we propose Representation Ensemble (RISE), a novel ensemble framework that enables cross-LLM representation sharing for richer information exchange. To address challenges of representation-level interaction caused by layer misalignment and latent-space incompatibility across LLMs, we introduce a representation alignment method based on relational similarity measures and an orthogonal latent-space transformation. Experimental results show that (1) RISE achieves performance competitive with existing decision ensemble methods, and (2) RISE is strongly complementary to decision ensemble, with their combination boosting collaboration gains by 14%–41%. Finally, we further compare ensemble of small LLMs to a single larger LLM and to model merging and composition approaches, and find that ensemble learning consistently generalizes well without additional training.
Anthology ID:
2026.tacl-1.79
Volume:
Transactions of the Association for Computational Linguistics, Volume 14
Month:
Year:
2026
Address:
Cambridge, MA
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
1765–1786
Language:
URL:
https://aclanthology.org/2026.tacl-1.79/
DOI:
10.1162/tacl.a.773
Bibkey:
Cite (ACL):
Yichong Huang, Xiaocheng Feng, Jinlan Fu, Xiachong Feng, Baohang Li, Zekai Ye, Libo Qin, Hao Fei, See-Kiong Ng, and Bing Qin. 2026. S HARING B EYOND D ECISION: Deep Collaboration between Large Language Models via Representation Ensemble. Transactions of the Association for Computational Linguistics, 14:1765–1786.
Cite (Informal):
S HARING B EYOND D ECISION: Deep Collaboration between Large Language Models via Representation Ensemble (Huang et al., TACL 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.tacl-1.79.pdf