TopWORDS-Poetry: Simultaneous Text Segmentation and Word Discovery for Classical Chinese Poetry via Bayesian Inference

Changzai Pan, Feiyue Li, Ke Deng


Abstract
As a precious cultural heritage of human beings, classical Chinese poetry has a very unique writing style and often contains special words that rarely appear in general Chinese texts, posting critical challenges for natural language processing. Little effort has been made in the literature for processing texts from classical Chinese poetry. This study fills in this gap with TopWORDS-Poetry, an unsupervised method that can achieve reliable text segmentation and word discovery for classical Chinese poetry simultaneously without pre-given vocabulary or training corpus. Experimental studies confirm that TopWORDS-Poetry can successfully recognize unique poetry words, such as named entities and literary allusions, from metrical poems of Complete Tang Poetry and segment these poetry lines into sequences of meaningful words with high quality.
Anthology ID:
2023.emnlp-main.205
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3372–3386
Language:
URL:
https://aclanthology.org/2023.emnlp-main.205
DOI:
10.18653/v1/2023.emnlp-main.205
Bibkey:
Cite (ACL):
Changzai Pan, Feiyue Li, and Ke Deng. 2023. TopWORDS-Poetry: Simultaneous Text Segmentation and Word Discovery for Classical Chinese Poetry via Bayesian Inference. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 3372–3386, Singapore. Association for Computational Linguistics.
Cite (Informal):
TopWORDS-Poetry: Simultaneous Text Segmentation and Word Discovery for Classical Chinese Poetry via Bayesian Inference (Pan et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-main.205.pdf
Video:
 https://aclanthology.org/2023.emnlp-main.205.mp4