From Text Segmentation to Smart Chaptering: A Novel Benchmark for Structuring Video Transcriptions

Fabian Retkowski, Alexander Waibel


Abstract
Text segmentation is a fundamental task in natural language processing, where documents are split into contiguous sections. However, prior research in this area has been constrained by limited datasets, which are either small in scale, synthesized, or only contain well-structured documents. In this paper, we address these limitations by introducing a novel benchmark YTSeg focusing on spoken content that is inherently more unstructured and both topically and structurally diverse. As part of this work, we introduce an efficient hierarchical segmentation model MiniSeg, that outperforms state-of-the-art baselines. Lastly, we expand the notion of text segmentation to a more practical “smart chaptering” task that involves the segmentation of unstructured content, the generation of meaningful segment titles, and a potential real-time application of the models.
Anthology ID:
2024.eacl-long.25
Volume:
Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
March
Year:
2024
Address:
St. Julian’s, Malta
Editors:
Yvette Graham, Matthew Purver
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
406–419
Language:
URL:
https://aclanthology.org/2024.eacl-long.25
DOI:
Bibkey:
Cite (ACL):
Fabian Retkowski and Alexander Waibel. 2024. From Text Segmentation to Smart Chaptering: A Novel Benchmark for Structuring Video Transcriptions. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 406–419, St. Julian’s, Malta. Association for Computational Linguistics.
Cite (Informal):
From Text Segmentation to Smart Chaptering: A Novel Benchmark for Structuring Video Transcriptions (Retkowski & Waibel, EACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.eacl-long.25.pdf