An Implementation of Werewolf Agent That does not Truly Trust LLMs

Takehiro Sato, Shintaro Ozaki, Daisaku Yokoyama


Abstract
Werewolf is an incomplete information game, which has several challenges when creating a computer agent as a player given the lack of understanding of the situation and individuality of utterance (e.g., computer agents are not capable of characterful utterance or situational lying). We propose a werewolf agent that solves some of those difficulties by combining a Large Language Model (LLM) and a rule-based algorithm. In particular, our agent uses a rule-based algorithm to select an output either from an LLM or a template prepared beforehand based on the results of analyzing conversation history using an LLM. It allows the agent to refute in specific situations, identify when to end the conversation, and behave with persona. This approach mitigated conversational inconsistencies and facilitated logical utterance as a result. We also conducted a qualitative evaluation, which resulted in our agent being perceived as more human-like compared to an unmodified LLM. The agent is freely available for contributing to advance the research in the field of Werewolf game.
Anthology ID:
2024.aiwolfdial-1.7
Volume:
Proceedings of the 2nd International AIWolfDial Workshop
Month:
September
Year:
2024
Address:
Tokyo, Japan
Editor:
Yoshinobu Kano
Venues:
AIWolfDial | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
58–67
Language:
URL:
https://aclanthology.org/2024.aiwolfdial-1.7
DOI:
Bibkey:
Cite (ACL):
Takehiro Sato, Shintaro Ozaki, and Daisaku Yokoyama. 2024. An Implementation of Werewolf Agent That does not Truly Trust LLMs. In Proceedings of the 2nd International AIWolfDial Workshop, pages 58–67, Tokyo, Japan. Association for Computational Linguistics.
Cite (Informal):
An Implementation of Werewolf Agent That does not Truly Trust LLMs (Sato et al., AIWolfDial-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.aiwolfdial-1.7.pdf
Supplementary attachment:
 2024.aiwolfdial-1.7.Supplementary_Attachment.pdf