Utilizing GPT-4 to Solve TextWorld Commonsense Games Efficiently

Binggang Zhuo, Masaki Murata


Abstract
Most artificial intelligence agents in interactive fiction games are implemented using reinforcement learning. Considering the recent rapid development of large language models, we propose an approach that utilizes a large language model to tackle interactive fiction game tasks. The chosen test dataset is TextWorld Commonsense, an interactive fiction game environment designed for artificial intelligence agents. In these games, the AI agent’s task is to organize rooms and place items in appropriate locations. To achieve a high score in the game, common sense knowledge about “which items belong to which locations” is important. Our approach is based on GPT-4 and a carefully designed prompt. Experimental results demonstrate that our approach outperforms prior research. Specifically, GPT-4 with feedback-augmented prompt successfully completed all tasks in both simple and medium level game environments without fine-tuning. In hard level game environments, our approach achieved a normalized score of 0.70, surpassing the best baseline score of 0.57.
Anthology ID:
2024.games-1.9
Volume:
Proceedings of the 10th Workshop on Games and Natural Language Processing @ LREC-COLING 2024
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Chris Madge, Jon Chamberlain, Karen Fort, Udo Kruschwitz, Stephanie Lukin
Venues:
games | WS
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
76–84
Language:
URL:
https://aclanthology.org/2024.games-1.9
DOI:
Bibkey:
Cite (ACL):
Binggang Zhuo and Masaki Murata. 2024. Utilizing GPT-4 to Solve TextWorld Commonsense Games Efficiently. In Proceedings of the 10th Workshop on Games and Natural Language Processing @ LREC-COLING 2024, pages 76–84, Torino, Italia. ELRA and ICCL.
Cite (Informal):
Utilizing GPT-4 to Solve TextWorld Commonsense Games Efficiently (Zhuo & Murata, games-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.games-1.9.pdf