Retrieval, Masking, and Generation: Feedback Comment Generation using Masked Comment Examples

Mana Ihori, Hiroshi Sato, Tomohiro Tanaka, Ryo Masumura


Abstract
In this paper, we propose a novel method, retrieval, masking, and generation, for feedback comment generation. Feedback comment generation is a task in which a system generates feedback comments such as hints or explanatory notes for language learners, given input text and position showing where to comment. In the conventional study, the retrieve-and-edit method for retrieving feedback comments in the data pool and editing the comments has been thought effective for this task. However, the performance of this method does not perform as well as other conventional methods because its model learns to edit tokens that do not need to be rewritten in the retrieved comments. To mitigate this problem, we propose a method for combining retrieval, masking, and generation based on the retrieve-and-edit method. Specifically, tokens of feedback comments retrieved from the data pool are masked, and this masked feedback comment is used as a template to generate feedback comments. The proposed method should prevent unnecessary conversion by using not retrieved feedback comments directly but masking them. Our experiments on feedback comment generation demonstrate that the proposed method outperforms conventional methods.
Anthology ID:
2023.inlg-genchal.9
Volume:
Proceedings of the 16th International Natural Language Generation Conference: Generation Challenges
Month:
September
Year:
2023
Address:
Prague, Czechia
Editor:
Simon Mille
Venues:
INLG | SIGDIAL
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
60–67
Language:
URL:
https://aclanthology.org/2023.inlg-genchal.9
DOI:
Bibkey:
Cite (ACL):
Mana Ihori, Hiroshi Sato, Tomohiro Tanaka, and Ryo Masumura. 2023. Retrieval, Masking, and Generation: Feedback Comment Generation using Masked Comment Examples. In Proceedings of the 16th International Natural Language Generation Conference: Generation Challenges, pages 60–67, Prague, Czechia. Association for Computational Linguistics.
Cite (Informal):
Retrieval, Masking, and Generation: Feedback Comment Generation using Masked Comment Examples (Ihori et al., INLG-SIGDIAL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.inlg-genchal.9.pdf