LLMberjack: Guided Trimming of Debate Trees for Multi-Party Conversation Creation

Leonardo Bottona, Nicolò Penzo, Bruno Lepri, Marco Guerini, Sara Tonelli


Abstract
Online debates on platforms like Reddit or Kialo are structured as reply trees: each message can receive several replies, which in turn can each receive several replies, producing a branching structure rather than a linear conversation. Turning one path (or a mix of paths) through such a tree into a natural, turn-by-turn conversation among multiple speakers (a process we call linearization) requires deciding which messages to keep, in what order, and who each message is addressed to. To this aim, we present LLMberjack, a platform for creating multi-party conversations starting from existing debates, originally structured as reply trees. The system offers an interactive interface that visualizes discussion trees and enables users to construct coherent linearized dialogue sequences while preserving participant identity and discourse relations. It integrates optional large language model (LLM) assistance to support automatic editing of the messages and speakers’ descriptions. We provide preliminary evidence about the platform’s utility by showing how tree visualization facilitates the creation of coherent, meaningful conversation threads and how LLM support enhances output quality while reducing human effort. The tool is open-source and designed to promote transparent and reproducible workflows to create multi-party conversations, addressing a lack of resources of this type.
Anthology ID:
2026.emnlp-demos.14
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Sweta Agrawal, Alberto Abad
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
149–159
Language:
URL:
https://aclanthology.org/2026.emnlp-demos.14/
DOI:
Bibkey:
Cite (ACL):
Leonardo Bottona, Nicolò Penzo, Bruno Lepri, Marco Guerini, and Sara Tonelli. 2026. LLMberjack: Guided Trimming of Debate Trees for Multi-Party Conversation Creation. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 149–159, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
LLMberjack: Guided Trimming of Debate Trees for Multi-Party Conversation Creation (Bottona et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-demos.14.pdf