Learning to Prompt: Improving Student Engagement with Adaptive LLM-based High-School Tutoring

Po-Chin Chang, Nicholas Hogan, Aske Plaat, Michiel T. van der Meer


Abstract
LLMs can personalize education, although current static-prompt tutoring systems struggle to adapt to diverse academic disciplines. We develop and test a system with subject-aware prompting, based on 14 pedagogical features (e.g., tutor scaffolding, student understanding) extracted from raw transcripts. We first train a prompt routing model in a simulation environment, and then deploy it for online adaptation with actual high-school students. The simulation benchmark shows the router outperforming two static baselines (0.694 vs. 0.647 and 0.64, p<0.001). A/B testing (N=656 conversations from 359 students) shows sim-to-real transfer where the model switches from analytical to scaffolding learning strategies. Our adaptive prompt selection mechanism improves instructional efficiency, maintains pedagogical quality and reduces interactions by around 3 turns (p=0.007). While a greedy router achieves a comparable exercise conversion rate with the baseline (19.1% vs. 19.6%), a stochastic router that samples strategies leads to a higher conversion rate (28.1%).
Anthology ID:
2026.emnlp-industry.24
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pepa Atanasova, Gholamreza Haffari, Minghan Wang
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
365–393
Language:
URL:
https://aclanthology.org/2026.emnlp-industry.24/
DOI:
Bibkey:
Cite (ACL):
Po-Chin Chang, Nicholas Hogan, Aske Plaat, and Michiel T. van der Meer. 2026. Learning to Prompt: Improving Student Engagement with Adaptive LLM-based High-School Tutoring. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 365–393, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Learning to Prompt: Improving Student Engagement with Adaptive LLM-based High-School Tutoring (Chang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-industry.24.pdf