Disentangled Phonetic Representation for Chinese Spelling Correction

Zihong Liang, Xiaojun Quan, Qifan Wang


Abstract
Chinese Spelling Correction (CSC) aims to detect and correct erroneous characters in Chinese texts. Although efforts have been made to introduce phonetic information (Hanyu Pinyin) in this task, they typically merge phonetic representations with character representations, which tends to weaken the representation effect of normal texts. In this work, we propose to disentangle the two types of features to allow for direct interaction between textual and phonetic information. To learn useful phonetic representations, we introduce a pinyin-to-character objective to ask the model to predict the correct characters based solely on phonetic information, where a separation mask is imposed to disable attention from phonetic input to text. To avoid overfitting the phonetics, we further design a self-distillation module to ensure that semantic information plays a major role in the prediction. Extensive experiments on three CSC benchmarks demonstrate the superiority of our method in using phonetic information.
Anthology ID:
2023.acl-long.755
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
13509–13521
Language:
URL:
https://aclanthology.org/2023.acl-long.755
DOI:
10.18653/v1/2023.acl-long.755
Bibkey:
Cite (ACL):
Zihong Liang, Xiaojun Quan, and Qifan Wang. 2023. Disentangled Phonetic Representation for Chinese Spelling Correction. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 13509–13521, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Disentangled Phonetic Representation for Chinese Spelling Correction (Liang et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.755.pdf
Video:
 https://aclanthology.org/2023.acl-long.755.mp4