SerialDistill: Retrieval-Conditioned On-Policy Distillation for Data-Scarce Serial Subtitle Translation

Yiran Zhang, Ziqi Zhang


Abstract
Serial subtitle translation requires work-specific terminology and translation conventions to be maintained across episodes, despite scarce bilingual supervision. Previously finalized subtitles provide both adaptation data and translation memory, but our experiments show that the benefit of combining supervised adaptation and retrieval varies across series. We introduce SerialDistill, which combines LoRA-based domain adaptation with retrieval-conditioned on-policy distributional distillation (OPD). A Qwen3-8B student generates translation trajectories, while a frozen Qwen3-14B teacher provides token-level supervision under the same bilingual context retrieved exclusively from previously finalized episodes. On Japanese-to-Chinese translation across two anime series, SerialDistill improves over the non-distilled LoRA-8B+RAG baseline by up to 3.80 chrF and 4.15 BLEU, measured on pooled held-out episodes. The student also outperforms the larger retrieval-augmented teacher, which has not undergone domain adaptation. These results support retrieval-conditioned distillation as an additional adaptation stage for data-scarce serial subtitle translation.
Anthology ID:
2026.wat-1.5
Volume:
Proceedings of the Thirteenth Workshop on Asian Translation (WAT 2026)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Toshiaki Nakazawa, Isao Goto
Venues:
WAT | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
71–83
Language:
URL:
https://aclanthology.org/2026.wat-1.5/
DOI:
Bibkey:
Cite (ACL):
Yiran Zhang and Ziqi Zhang. 2026. SerialDistill: Retrieval-Conditioned On-Policy Distillation for Data-Scarce Serial Subtitle Translation. In Proceedings of the Thirteenth Workshop on Asian Translation (WAT 2026), pages 71–83, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
SerialDistill: Retrieval-Conditioned On-Policy Distillation for Data-Scarce Serial Subtitle Translation (Zhang & Zhang, WAT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wat-1.5.pdf