Raquel Coelho
Author directory2026
Evaluating Feedback Focus and Pedagogical Adaptivity in LLM Feedback on Student Writing
Norah Almousa | Shayan Peyghambari Oskoui | Raquel Coelho | Gayle Rogers | Xiang Lorraine Li | Diane Litman
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Norah Almousa | Shayan Peyghambari Oskoui | Raquel Coelho | Gayle Rogers | Xiang Lorraine Li | Diane Litman
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
We examine whether LLMs generate feedback aligned with expert teachers’ practices in feedback focus and adaptivity. We present FeedType, a benchmark of annotated teacher and LLM feedback to evaluate this alignment. Results reveal that while LLMs cover most feedback types, they fail to fully replicate teachers’ feedback distributions and adaptivity.
Neuron-Aware Active Few-Shot Learning for LLMs
Zhuowei Chen | Liwei Chen | Christian Schunn | Raquel Coelho | Xiang Lorraine Li
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zhuowei Chen | Liwei Chen | Christian Schunn | Raquel Coelho | Xiang Lorraine Li
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Active Few-Shot Learning (AFSL) adapts LLMs to specialized domains by identifying the most valuable unlabeled samples for annotation and use as few-shot demonstrations, effectively reducing human annotation costs while promoting high performance. However, existing methods typically rely on output-level signals for the sample identification, such as predictive entropy or semantic similarities with test-time data based on external embeddings, which often overlook models’ internal dynamics which could pinpoint specific knowledge gaps. To bridge this gap, we propose NeuFS, a Neuron-Aware Active Few-Shot Learning framework that shifts the selection paradigm from output-level proxies to models’ internal dynamics. NeuFS utilizes neuron activation patterns to represent sample directly, and includes a dual-criteria selection strategy that: (1) ensures few-shot sample diversity with neuron patterns for broader example coverage, while (2) prioritizing on identifying informative and challenging few-shot samples LLMs tend to hallucinate by quantifying neuron consensus. Experiments on three datasets demonstrate that NeuFS excels in both reasoning and text classification tasks, outperforming existing AFSL baselines. Ablation studies further highlight that internal neuron activations provide a more principled and effective selection signal than external embeddings, validating the superiority of the proposed NeuFS.