Paragraph Segmentation Revisited: Towards a Standard Task for Structuring Speech

Fabian Retkowski, Alexander Waibel


Abstract
Automatic speech transcripts are often delivered as unstructured word streams that impede readability and repurposing. We recast paragraph segmentation as the missing structuring step and fill three gaps at the intersection of speech processing and text segmentation. First, we establish TEDPara (human-annotated TED talks) and YTSegPara (YouTube videos with synthetic labels) as the first benchmarks for the paragraph segmentation task. The benchmarks focus on the underexplored speech domain, where paragraph segmentation has traditionally not been part of post-processing, while also contributing to the wider text segmentation field, which still lacks robust and naturalistic benchmarks. Second, we propose a constrained-decoding formulation that lets large language models insert paragraph breaks while preserving the original transcript, enabling faithful, sentence-aligned evaluation. Third, we show that a compact model (MiniSeg) attains state-of-the-art accuracy and, when extended hierarchically, jointly predicts chapters and paragraphs with minimal computational cost. Together, our resources and methods establish paragraph segmentation as a standardized, practical task in speech processing.
Anthology ID:
2026.lrec-1.55
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
747–759
Language:
External URL:
https://lrec.elra.info/lrec2026-main-055
DOI:
10.63317/3eczsids4mek
Bibkey:
Cite (ACL):
Fabian Retkowski and Alexander Waibel. 2026. Paragraph Segmentation Revisited: Towards a Standard Task for Structuring Speech. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 747–759, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
Paragraph Segmentation Revisited: Towards a Standard Task for Structuring Speech (Retkowski & Waibel, LREC 2026)
Copy Citation: