NRD: A Hybrid Disentanglement Framework for Mitigating Interference in Multilingual Machine Translation

Jiarui Zhang, Yifan Deng


Abstract
Negative interference from cross-lingual conflicting syntactic patterns is a primary obstacle in Multilingual Neural Machine Translation (MNMT). We trace this problem to the entanglement of transferable, universal semantics with non-transferable, language-specific syntactic structures. Existing methods, relying on disjoint training-only specialization or inference-only filtering, fail to fully resolve this fundamental entanglement. To address this, we propose NRD (Neuron Representation Disentanglement), a two-stage hybrid framework that couples training-time specialization with inference-time filtering. First, a Specialization Fine-tuning stage identifies functional neurons via a semantic-invariant activation-variance metric and reinforces intrinsic modularity through sparse updates. Second, a Dynamic Representation Filtering stage purifies semantic representations at inference by adaptively suppressing syntax-sensitive neurons, guided by each language’s pre-computed gradient consistency. On the OPUS-100 benchmark, NRD outperforms strong baselines, achieving an average gain of +1.9 BLEU on supervised directions. On the WMT-10 zero-shot benchmark, it obtains a substantial +7.1 BLEU, demonstrating robust cross-lingual generalization. These results provide strong evidence that our hybrid approach effectively purifies semantic representations by mitigating syntactic interference, paving the way for more robust cross-lingual generalization.
Anthology ID:
2026.lrec-1.677
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
8577–8586
Language:
External URL:
https://lrec.elra.info/lrec2026-main-677
DOI:
10.63317/55wnhwvmezwx
Bibkey:
Cite (ACL):
Jiarui Zhang and Yifan Deng. 2026. NRD: A Hybrid Disentanglement Framework for Mitigating Interference in Multilingual Machine Translation. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 8577–8586, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
NRD: A Hybrid Disentanglement Framework for Mitigating Interference in Multilingual Machine Translation (Zhang & Deng, LREC 2026)
Copy Citation: