DiffG-RL: Leveraging Difference between Environment State and Common Sense

Tsunehiko Tanaka, Daiki Kimura, Michiaki Tatsubori


Abstract
Taking into account background knowledge as the context has always been an important part of solving tasks that involve natural language. One representative example of such tasks is text-based games, where players need to make decisions based on both description text previously shown in the game, and their own background knowledge about the language and common sense. In this work, we investigate not simply giving common sense, as can be seen in prior research, but also its effective usage. We assume that a part of the environment states different from common sense should constitute one of the grounds for action selection. We propose a novel agent, DiffG-RL, which constructs a Difference Graph that organizes the environment states and common sense by means of interactive objects with a dedicated graph encoder. DiffG-RL also contains a framework for extracting the appropriate amount and representation of common sense from the source to support the construction of the graph. We validate DiffG-RL in experiments with text-based games that require common sense and show that it outperforms baselines by 17% of scores. We will make our code publicly available.
Anthology ID:
2022.findings-emnlp.110
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2022
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates
Editors:
Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1534–1546
Language:
URL:
https://aclanthology.org/2022.findings-emnlp.110
DOI:
10.18653/v1/2022.findings-emnlp.110
Bibkey:
Cite (ACL):
Tsunehiko Tanaka, Daiki Kimura, and Michiaki Tatsubori. 2022. DiffG-RL: Leveraging Difference between Environment State and Common Sense. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 1534–1546, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
DiffG-RL: Leveraging Difference between Environment State and Common Sense (Tanaka et al., Findings 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.findings-emnlp.110.pdf
Video:
 https://aclanthology.org/2022.findings-emnlp.110.mp4