Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code

Ryan Volum, Sudha Rao, Michael Xu, Gabriel DesGarennes, Chris Brockett, Benjamin Van Durme, Olivia Deng, Akanksha Malhotra, Bill Dolan


Abstract
Non-Player Characters (NPCs) significantly enhance the player experience in many games. Historically, players’ interactions with NPCs have tended to be highly scripted, to be limited to natural language responses to be selected by the player, and to not involve dynamic change in game state. In this work, we demonstrate that use of a few example conversational prompts can power a conversational agent to generate both natural language and novel code. This approach can permit development of NPCs with which players can have grounded conversations that are free-form and less repetitive. We demonstrate our approach using OpenAI Codex (GPT-3 finetuned on GitHub), with Minecraft game development as our test bed. We show that with a few example prompts, a Codex-based agent can generate novel code, hold multi-turn conversations and answer questions about structured data. We evaluate this application using experienced gamers in a Minecraft realm and provide analysis of failure cases and suggest possible directions for solutions.
Anthology ID:
2022.wordplay-1.3
Volume:
Proceedings of the 3rd Wordplay: When Language Meets Games Workshop (Wordplay 2022)
Month:
July
Year:
2022
Address:
Seattle, United States
Editors:
Marc-Alexandre Côté, Xingdi Yuan, Prithviraj Ammanabrolu
Venue:
Wordplay
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
25–43
Language:
URL:
https://aclanthology.org/2022.wordplay-1.3
DOI:
10.18653/v1/2022.wordplay-1.3
Bibkey:
Cite (ACL):
Ryan Volum, Sudha Rao, Michael Xu, Gabriel DesGarennes, Chris Brockett, Benjamin Van Durme, Olivia Deng, Akanksha Malhotra, and Bill Dolan. 2022. Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code. In Proceedings of the 3rd Wordplay: When Language Meets Games Workshop (Wordplay 2022), pages 25–43, Seattle, United States. Association for Computational Linguistics.
Cite (Informal):
Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code (Volum et al., Wordplay 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.wordplay-1.3.pdf
Code
 microsoft/interactive-minecraft-npcs