ALIGNMEET: A Comprehensive Tool for Meeting Annotation, Alignment, and Evaluation

Peter Polák, Muskaan Singh, Anna Nedoluzhko, Ondřej Bojar


Abstract
Summarization is a challenging problem, and even more challenging is to manually create, correct, and evaluate the summaries. The severity of the problem grows when the inputs are multi-party dialogues in a meeting setup. To facilitate the research in this area, we present ALIGNMEET, a comprehensive tool for meeting annotation, alignment, and evaluation. The tool aims to provide an efficient and clear interface for fast annotation while mitigating the risk of introducing errors. Moreover, we add an evaluation mode that enables a comprehensive quality evaluation of meeting minutes. To the best of our knowledge, there is no such tool available. We release the tool as open source. It is also directly installable from PyPI.
Anthology ID:
2022.lrec-1.188
Volume:
Proceedings of the Thirteenth Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
1771–1779
Language:
URL:
https://aclanthology.org/2022.lrec-1.188
DOI:
Bibkey:
Cite (ACL):
Peter Polák, Muskaan Singh, Anna Nedoluzhko, and Ondřej Bojar. 2022. ALIGNMEET: A Comprehensive Tool for Meeting Annotation, Alignment, and Evaluation. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 1771–1779, Marseille, France. European Language Resources Association.
Cite (Informal):
ALIGNMEET: A Comprehensive Tool for Meeting Annotation, Alignment, and Evaluation (Polák et al., LREC 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.lrec-1.188.pdf