Evaluation of Commonsense Reasoning and Moral Understanding in Children’s Stories

Yan Guohang, Liang Feihao, Guo Yaxin, Tan Hongye, Li Ru, Zhang Hu


Abstract
“This paper provides a comprehensive review of the the CCL24-Eval Task 8: Commonsense Reasoning and Moral Understanding in Children’s Stories(CRMUS). This task has designed two sub-tasks, which aim to assess the commonsense reasoning and implicit meaning comprehension capabilities of Large Language Models(LLMs). We heve received registration forms from 33 teams, 15 of which submitted final results that exceeded the baseline score. We present the results of the top 5 teams and our analysis of these results.”
Anthology ID:
2024.ccl-3.39
Volume:
Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 3: Evaluations)
Month:
July
Year:
2024
Address:
Taiyuan, China
Editors:
Hongfei Lin, Hongye Tan, Bin Li
Venue:
CCL
SIG:
Publisher:
Chinese Information Processing Society of China
Note:
Pages:
346–352
Language:
English
URL:
https://aclanthology.org/2024.ccl-3.39/
DOI:
Bibkey:
Cite (ACL):
Yan Guohang, Liang Feihao, Guo Yaxin, Tan Hongye, Li Ru, and Zhang Hu. 2024. Evaluation of Commonsense Reasoning and Moral Understanding in Children’s Stories. In Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 3: Evaluations), pages 346–352, Taiyuan, China. Chinese Information Processing Society of China.
Cite (Informal):
Evaluation of Commonsense Reasoning and Moral Understanding in Children’s Stories (Guohang et al., CCL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.ccl-3.39.pdf