PTCG-Bench: Can LLM Agents Master Pokémon Trading Card Game?

Dongdong Hua, Yifei Sun, Renhong Huang, Chunping Wang, Feng Gao, Yang Yang


Abstract
Given a strategically complex board game, human players can quickly learn to devise strategies after playing a few rounds. Autonomous agents require similar capabilities in realistic interactive environments, yet existing agent benchmarks often fail to fully capture such strategic and evolving decision-making scenarios. We present **PTCG-Bench**, a benchmark built on the Pok’emon Trading Card Game (PTCG) that evaluates LLM agents at two complementary levels: (1) their decision-making performance within a single complex environment, and (2) their ability to self-evolving through accumulated experience. We further include a modular harness ablation to better interpret agent performance without conflating it with model capability. Our experiments show that, although LLM agents can achieve non-trivial gameplay performance, sustained and stable self-evolution remains challenging, and performance is sensitive to harness design. We hope that PTCG-Bench will facilitate future research on harness-aware and self-evolving agents in realistic interactive environments.
Anthology ID:
2026.findings-emnlp.1689
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
36084–36099
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1689/
DOI:
Bibkey:
Cite (ACL):
Dongdong Hua, Yifei Sun, Renhong Huang, Chunping Wang, Feng Gao, and Yang Yang. 2026. PTCG-Bench: Can LLM Agents Master Pokémon Trading Card Game?. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 36084–36099, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
PTCG-Bench: Can LLM Agents Master Pokémon Trading Card Game? (Hua et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1689.pdf