Leveraging LLMs for Chinese Frame Semantic Parsing

Liu Yahui, Gong Chen, Zhang Min


Abstract
“We participate in the open track of the Chinese frame semantic parsing (CFSP) task, i.e., CCL24Eval Task 1, and our submission ranks first. FSP is an important task in Natural Language Processing, aiming to extract the frame semantic structures from sentences, which can be divided into three subtasks, e.g., Frame Identification (FI), Argument Identification (AI), and Role Identification (RI). In this paper, we use the LLM Gemini 1.0 to evaluate the three subtasks of CFSP, and present the techniques and strategies we employed to enhance subtasks performance. For FI, we leverage mapping and similarity strategies to minimize the candidate frames for each target word, which can reduce the complexity of the LLM in identifying the appropriate frame. For AI and RI subtasks, we utilize the results from small models as auxiliary information and apply data augmentation, self-training, and model ensemble techniques on these small models to further enhance the performance of subtasks.”
Anthology ID:
2024.ccl-3.3
Volume:
Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 3: Evaluations)
Month:
July
Year:
2024
Address:
Taiyuan, China
Editors:
Hongfei Lin, Hongye Tan, Bin Li
Venue:
CCL
SIG:
Publisher:
Chinese Information Processing Society of China
Note:
Pages:
21–31
Language:
English
URL:
https://aclanthology.org/2024.ccl-3.3/
DOI:
Bibkey:
Cite (ACL):
Liu Yahui, Gong Chen, and Zhang Min. 2024. Leveraging LLMs for Chinese Frame Semantic Parsing. In Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 3: Evaluations), pages 21–31, Taiyuan, China. Chinese Information Processing Society of China.
Cite (Informal):
Leveraging LLMs for Chinese Frame Semantic Parsing (Yahui et al., CCL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.ccl-3.3.pdf