WSpeller: Robust Word Segmentation for Enhancing Chinese Spelling Check

Fangfang Li, Youran Shan, Junwen Duan, Xingliang Mao, Minlie Huang


Abstract
Chinese spelling check (CSC) detects and corrects spelling errors in Chinese texts. Previous approaches have combined character-level phonetic and graphic information, ignoring the importance of segment-level information. According to our pilot study, spelling errors are always associated with incorrect word segmentation. When appropriate word boundaries are provided, CSC performance is greatly enhanced. Based on these findings, we present WSpeller, a CSC model that takes into account word segmentation. A fundamental component of WSpeller is a W-MLM, which is trained by predicting visually and phonetically similar words. Through modification of the embedding layer’s input, word segmentation information can be incorporated. Additionally, a robust module is trained to assist the W-MLM-based correction module by predicting the correct word segmentations from sentences containing spelling errors. We evaluate WSpeller on the widely used benchmark datasets SIGHAN13, SIGHAN14, and SIGHAN15. Our model is superior to state-of-the-art baselines on SIGHAN13 and SIGHAN15 and maintains equal performance on SIGHAN14.
Anthology ID:
2022.findings-emnlp.84
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2022
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates
Editors:
Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1179–1188
Language:
URL:
https://aclanthology.org/2022.findings-emnlp.84
DOI:
10.18653/v1/2022.findings-emnlp.84
Bibkey:
Cite (ACL):
Fangfang Li, Youran Shan, Junwen Duan, Xingliang Mao, and Minlie Huang. 2022. WSpeller: Robust Word Segmentation for Enhancing Chinese Spelling Check. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 1179–1188, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
WSpeller: Robust Word Segmentation for Enhancing Chinese Spelling Check (Li et al., Findings 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.findings-emnlp.84.pdf