Investigating Learner-Aware Design of LLM-Generated Educational Feedback

Momoka Furuhashi, Kouta Nakayama, Noboru Kawai, Takashi Kodama, Saku Sugawara, Kyosuke Takami


Abstract
Although large language models (LLMs) show promise for generating educational feedback, it remains unclear how feedback should be designed (e.g., tone and coverage) to support answer revision and learner evaluations across learner profiles. We define six feedback designs for multiple-choice biology questions, including a baseline design and five variants with additional feedback elements, and conduct an empirical study with 321 high school students. We evaluate feedback using immediate revision performance and six subjective evaluation criteria, and analyze differences in subjective evaluations across learner profiles based on personality traits. Our results show that presenting task-relevant information clearly is associated with better immediate revision performance and is favorably evaluated across learner profiles, while we observe descriptive differences in evaluation patterns, particularly for informational novelty and affective framing. These findings support further investigation of personalized LLM feedback design.
Anthology ID:
2026.findings-aacl.4
Volume:
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
45–73
Language:
URL:
https://aclanthology.org/2026.findings-aacl.4/
DOI:
Bibkey:
Cite (ACL):
Momoka Furuhashi, Kouta Nakayama, Noboru Kawai, Takashi Kodama, Saku Sugawara, and Kyosuke Takami. 2026. Investigating Learner-Aware Design of LLM-Generated Educational Feedback. In Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026, pages 45–73, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
Investigating Learner-Aware Design of LLM-Generated Educational Feedback (Furuhashi et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-aacl.4.pdf