Dandan Chen Kaptur
Author directory2026
Prompting as Measurement: Enhancing Coding for Systematic Reviews with Large Language Models
Dandan Chen Kaptur | Yue Huang | Yanhui Guo | Xuejun Ryan Ji
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Dandan Chen Kaptur | Yue Huang | Yanhui Guo | Xuejun Ryan Ji
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Prompting functions as a measurement condition that alters LLM coding behavior. We examined whether few-shot prompting improves GPT-based qualitative coding in systematic reviews. Contrary to expectations, we found that the zero-shot approach produced the highest agreement with human coders, suggesting increasing conservatism as more prompt structure was added.