Werewolf Game Agent by Generative AI Incorporating Logical Information Between Players

Neo Watanabe, Yoshinobu Kano


Abstract
In recent years, AI models based on GPT have advanced rapidly. These models are capable of generating text, translating between different languages, and answering questions with high accuracy. However, the process behind their outputs remains a black box, making it difficult to ascertain the data influencing their responses. These AI models do not always produce accurate outputs and are known for generating incorrect information, known as hallucinations, whose causes are hard to pinpoint. Moreover, they still face challenges in solving complex problems that require step-by-step reasoning, despite various improvements like the Chain-of-Thought approach. There’s no guarantee that these models can independently perform logical reasoning from scratch, raising doubts about the reliability and accuracy of their inferences. To address these concerns, this study proposes the incorporation of an explicit logical structure into the AI’s text generation process. As a validation experiment, a text-based agent capable of playing the Werewolf game, which requires deductive reasoning, was developed using GPT-4. By comparing the model combined with an external explicit logical structure and a baseline that lacks such a structure, the proposed method demonstrated superior reasoning capabilities in subjective evaluations, suggesting the effectiveness of adding an explicit logical framework to the conventional AI models.
Anthology ID:
2024.aiwolfdial-1.3
Volume:
Proceedings of the 2nd International AIWolfDial Workshop
Month:
September
Year:
2024
Address:
Tokyo, Japan
Editor:
Yoshinobu Kano
Venues:
AIWolfDial | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
21–29
Language:
URL:
https://aclanthology.org/2024.aiwolfdial-1.3
DOI:
Bibkey:
Cite (ACL):
Neo Watanabe and Yoshinobu Kano. 2024. Werewolf Game Agent by Generative AI Incorporating Logical Information Between Players. In Proceedings of the 2nd International AIWolfDial Workshop, pages 21–29, Tokyo, Japan. Association for Computational Linguistics.
Cite (Informal):
Werewolf Game Agent by Generative AI Incorporating Logical Information Between Players (Watanabe & Kano, AIWolfDial-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.aiwolfdial-1.3.pdf