ACE: A LLM-based Negotiation Coaching System

Ryan Shea, Aymen Kallala, Xin Liu, Michael Morris, Zhou Yu


Abstract
The growing prominence of LLMs has led to an increase in the development of AI tutoring systems. These systems are crucial in providing underrepresented populations with improved access to valuable education. One important area of education that is unavailable to many learners is strategic bargaining related to negotiation. To address this, we develop a LLM-based Assistant for Coaching nEgotiation (ACE). ACE not only serves as a negotiation partner for users but also provides them with targeted feedback for improvement. To build our system, we collect a dataset of negotiation transcripts between MBA students. These transcripts come from trained negotiators and emulate realistic bargaining scenarios. We use the dataset, along with expert consultations, to design an annotation scheme for detecting negotiation mistakes. ACE employs this scheme to identify mistakes and provide targeted feedback to users. To test the effectiveness of ACE-generated feedback, we conducted a user experiment with two consecutive trials of negotiation and found that it improves negotiation performances significantly compared to a system that doesn’t provide feedback and one which uses an alternative method of providing feedback.
Anthology ID:
2024.emnlp-main.709
Volume:
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
12720–12749
Language:
URL:
https://aclanthology.org/2024.emnlp-main.709
DOI:
Bibkey:
Cite (ACL):
Ryan Shea, Aymen Kallala, Xin Liu, Michael Morris, and Zhou Yu. 2024. ACE: A LLM-based Negotiation Coaching System. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 12720–12749, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
ACE: A LLM-based Negotiation Coaching System (Shea et al., EMNLP 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.emnlp-main.709.pdf
Software:
 2024.emnlp-main.709.software.zip
Data:
 2024.emnlp-main.709.data.zip