Andy Hau Yan Ho
2025
SMARTMiner: Extracting and Evaluating SMART Goals from Low-Resource Health Coaching Notes
Iva Bojic
|
Qi Chwen Ong
|
Stephanie Hilary Xinyi Ma
|
Lin Ai
|
Zheng Liu
|
Ziwei Gong
|
Julia Hirschberg
|
Andy Hau Yan Ho
|
Andy W. H. Khong
Findings of the Association for Computational Linguistics: EMNLP 2025
We present SMARTMiner, a framework for extracting and evaluating specific, measurable, attainable, relevant, time-bound (SMART) goals from unstructured health coaching (HC) notes. Developed in response to challenges observed during a clinical trial, the SMARTMiner achieves two tasks: (i) extracting behavior change goal spans and (ii) categorizing their SMARTness. We also introduce SMARTSpan, the first publicly available dataset of 173 HC notes annotated with 266 goals and SMART attributes. SMARTMiner incorporates an extractive goal retriever with a component-wise SMARTness classifier. Experiment results show that extractive models significantly outperformed their generative counterparts in low-resource settings, and that two-stage fine-tuning substantially boosted performance. The SMARTness classifier achieved up to 0.91 SMART F1 score, while the full SMARTMiner maintained high end-to-end accuracy. This work bridges healthcare, behavioral science, and natural language processing to support health coaches and clients with structured goal tracking - paving way for automated weekly goal reviews between human-led HC sessions. Both the code and the dataset are available at: https://github.com/IvaBojic/SMARTMiner.
Search
Fix author
Co-authors
- Lin Ai 1
- Iva Bojic 1
- Ziwei Gong 1
- Julia Hirschberg 1
- Andy W. H. Khong 1
- show all...