Meng Chen
Author directoryOther people with similar names: Meng Chen
Unverified author pages with similar names: Meng Chen
2026
DigitalCoach: Communication and Grounding Gaps in Human and Agentic Computer Use Coaching
Meng Chen | Anya Ji | Tsung-Han Wu | Tobias Maringgele | David M. Chan | Alane Suhr | Amy Pavel
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Meng Chen | Anya Ji | Tsung-Han Wu | Tobias Maringgele | David M. Chan | Alane Suhr | Amy Pavel
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Agents are increasingly capable of automating software tasks, but can they teach humans how to use software themselves? We introduce DigitalCoach, a multimodal dataset of 72 human expert-novice computer use coaching sessions consisting of 22,752 dialogue turns grounded in 28.1 hours of screen and input event recordings across 5 software applications. We then use DigitalCoach to evaluate whether state-of-the-art models can teach humans how to use computers. Our automated evaluation shows that models differ from humans in how they coach: models provide more direct instructions, but fewer explanations, error diagnoses, and knowledge-check questions. When we fix the coaching method, models produce utterances that are similar to human references, but poorly grounded in visual context. Our interactive evaluation confirms that model coaches cause learners to passively follow instructions without deeper engagement and fall short in visual grounding. DigitalCoach lays a foundation for collaborative and proactive computer use coaching agents. Data and code are available at https://project-digital-coach.vercel.app