Feedback as a Guide: Enhancing LLM Comprehension of Modern Chinese Poetry

Shanshan Wang, Derek F. Wong, Jiebo Luo, Jingming Yao, Lidia S. Chao


Abstract
The performance of large language models (LLMs) on poetry-related tasks has drawn increasing attention from researchers. Since understanding of poetry is fundamental to all poetry-related tasks, enhancing LLMs’ comprehension of poetry is crucial for advancing this field. In this study, we propose a novel method to improve LLMs’ comprehension of modern Chinese poetry. This method utilizes feedback from reliable LLM evaluators as guidance to enhance other LLMs’ understanding of poetry in specific dimensions. To identify reliable LLM evaluators, we evaluate the initial performance of several mainstream LLMs on poetry comprehension tasks and further refine their evaluation capabilities until they approach human (expert) performance. These reliable LLMs are then employed as evaluators to simulate poet’s perspective in assessing the poetry comprehension of other LLMs, providing reasons and suggestions for improvement. Experimental results show that our method effectively enhances LLMs’ comprehension of poetry across multiple dimensions.
Anthology ID:
2026.findings-emnlp.475
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
9965–9986
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.475/
DOI:
Bibkey:
Cite (ACL):
Shanshan Wang, Derek F. Wong, Jiebo Luo, Jingming Yao, and Lidia S. Chao. 2026. Feedback as a Guide: Enhancing LLM Comprehension of Modern Chinese Poetry. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 9965–9986, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Feedback as a Guide: Enhancing LLM Comprehension of Modern Chinese Poetry (Wang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.475.pdf