Nam Ho Koh
Author directory2026
Same Tasks, Different Apps: Why Mobile GUI Agents Fail to Generalize?
Tien Tran | Nam Ho Koh | Daiki E. Matsunaga | Ayush Jain | Kee-Eung Kim
Findings of the Association for Computational Linguistics: EMNLP 2026
Tien Tran | Nam Ho Koh | Daiki E. Matsunaga | Ayush Jain | Kee-Eung Kim
Findings of the Association for Computational Linguistics: EMNLP 2026
Mobile GUI agents deployed in real settings must work across different applications that support the same functionality. Most existing benchmarks test each task in only one app, so a high score can mean the agent understands the task, or only that it knows that particular app. We introduce AnyAppBench, a category-controlled live Android benchmark that evaluates cross-application generalization while keeping the user goal fixed. It spans 10 functional categories, 100 task templates, and 520 task–application pairs over 52 applications. Agents run from raw instructions and with app-independent sub-goals, and a VLM judge labels every failed run under a fixed failure taxonomy whose reliability is measured by human annotation. We find that, across 13 agents, success on the original application does not transfer reliably to new applications with the same goal. Furthermore, providing high-level sub-goal decomposition produces only small, category-dependent changes that do not close the gap, and the mix of failure types changes with the target interface. Based on those insights, we believe the AnyAppBench benchmark provides an important stepping stone toward robust real-world deployment of mobile GUI agents. Our code, data and the leaderboard can be found at the project website https://anyappbench.github.io/.
Dynamic Context Allocation for Concurrent Multi-Agent LLMs
Junho Na | Daiki E. Matsunaga | Nam Ho Koh | Jongmin Lee | Pascal Poupart | Kee-Eung Kim
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Junho Na | Daiki E. Matsunaga | Nam Ho Koh | Jongmin Lee | Pascal Poupart | Kee-Eung Kim
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Concurrent multi-agent LLM systems increasingly rely on role-specialized Workers that act in parallel, but effective coordination depends not only on what Workers generate, but also on what task state each Worker observes before generating. Existing systems usually fix this observation interface through workflow rules, retrieval heuristics, or full-history sharing, so information flow cannot adapt as task state and feedback evolve. We introduce Dynamic Context Allocation (DCA), which treats per-Worker observation control as a trainable coordination problem for a fixed-role team. An RL-trained Context Allocator maintains a bounded Context Board and decides before each round which evolving task-state entries should be retained, revised, removed, or exposed to each Worker, rather than learning agent selection, execution order, or workflow topology. We evaluate DCA on cooperative code generation, Customer Relationship Management (CRM) lead qualification, and MultiWebGen, a new benchmark for multi-agent full-stack web development. Across these settings, DCA improves over fixed-protocol coordination and fixed-context multi-agent RL baselines, and it outperforms all evaluated frontier single-agent LLMs on CRM lead qualification despite using smaller role-specialized Workers.