Red Teaming Language Models for Processing Contradictory Dialogues

Xiaofei Wen, Bangzheng Li, Tenghao Huang, Muhao Chen


Abstract
Most language models currently available are prone to self-contradiction during dialogues. To mitigate this issue, this study explores a novel contradictory dialogue processing task that aims to detect and modify contradictory statements in a conversation. This task is inspired by research on context faithfulness and dialogue comprehension, which have demonstrated that the detection and understanding of contradictions often necessitate detailed explanations. We develop a dataset comprising contradictory dialogues, in which one side of the conversation contradicts itself. Each dialogue is accompanied by an explanatory label that highlights the location and details of the contradiction. With this dataset, we present a Red Teaming framework for contradictory dialogue processing. The framework detects and attempts to explain the dialogue, then modifies the existing contradictory content using the explanation. Our experiments demonstrate that the framework improves the ability to detect contradictory dialogues and provides valid explanations. Additionally, it showcases distinct capabilities for modifying such dialogues. Our study highlights the importance of the logical inconsistency problem in conversational AI.
Anthology ID:
2024.emnlp-main.648
Volume:
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
11611–11630
Language:
URL:
https://aclanthology.org/2024.emnlp-main.648
DOI:
10.18653/v1/2024.emnlp-main.648
Bibkey:
Cite (ACL):
Xiaofei Wen, Bangzheng Li, Tenghao Huang, and Muhao Chen. 2024. Red Teaming Language Models for Processing Contradictory Dialogues. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 11611–11630, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
Red Teaming Language Models for Processing Contradictory Dialogues (Wen et al., EMNLP 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.emnlp-main.648.pdf
Data:
 2024.emnlp-main.648.data.zip