Online Strategic Reasoning for LLM-Based Negotiation via Opponent-Aware Monte Carlo Tree Search

Chen-Cheng Huang, Yi-Cheng Wang, Hung-Lin Hu, Yi-Ren Yeh, Chu-song Chen


Abstract
Large language models (LLMs) have shown strong reasoning abilities in mathematical reasoning, commonsense reasoning, and code generation. However, negotiation requires interactive reasoning, where each action can influence the opponent’s future behavior. Agents must therefore look beyond the current dialogue state and consider the long-term effects of their actions. Existing LLM-based negotiation agents often rely on prompting or fine-tuning from self-play trajectories. These methods can produce fluent responses and help models learn useful bargaining patterns. Yet at decision time, they often remain reactive, responding mainly to the current dialogue without reasoning about how different actions may shape future negotiation paths. We introduce an online strategic reasoning method that combines Monte Carlo Tree Search (MCTS)-based lookahead planning with opponent simulation. Before responding, our agent uses a proxy opponent agent to simulate future interactions and evaluate candidate strategies by their expected long-term outcomes. To make opponent simulation more precise, we proposed a Theory-of-Mind-inspired opponent modeling module that infers latent opponent attributes from dialogue history and conditions the proxy opponent agent during search. Experiments on CraigslistBargain and A2A-NT show that our method improves negotiation efficiency and profitability.
Anthology ID:
2026.findings-emnlp.2277
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
48740–48756
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2277/
DOI:
10.18653/2026.findings-emnlp.2277
Bibkey:
Cite (ACL):
Chen-Cheng Huang, Yi-Cheng Wang, Hung-Lin Hu, Yi-Ren Yeh, and Chu-song Chen. 2026. Online Strategic Reasoning for LLM-Based Negotiation via Opponent-Aware Monte Carlo Tree Search. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 48740–48756, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Online Strategic Reasoning for LLM-Based Negotiation via Opponent-Aware Monte Carlo Tree Search (Huang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2277.pdf