MaintNorm: A corpus and benchmark model for lexical normalisation and masking of industrial maintenance short text

Tyler Bikaun, Melinda Hodkiewicz, Wei Liu


Abstract
Maintenance short texts are invaluable unstructured data sources, serving as a diagnostic and prognostic window into the operational health and status of physical assets. These user-generated texts, created during routine or ad-hoc maintenance activities, offer insights into equipment performance, potential failure points, and maintenance needs. However, the use of information captured in these texts is hindered by inherent challenges: the prevalence of engineering jargon, domain-specific vernacular, random spelling errors without identifiable patterns, and the absence of standard grammatical structures. To transform these texts into accessible and analysable data, we introduce the MaintNorm dataset, the first resource specifically tailored for the lexical normalisation task of maintenance short texts. Comprising 12,000 examples, this dataset enables the efficient processing and interpretation of these texts. We demonstrate the utility of MaintNorm by training a lexical normalisation model as a sequence-to-sequence learning task with two learning objectives, namely, enhancing the quality of the texts and masking segments to obscure sensitive information to anonymise data. Our benchmark model demonstrates a universal error reduction rate of 95.8%. The dataset and benchmark outcomes are available to the public.
Anthology ID:
2024.wnut-1.7
Volume:
Proceedings of the Ninth Workshop on Noisy and User-generated Text (W-NUT 2024)
Month:
March
Year:
2024
Address:
San Ġiljan, Malta
Editors:
Rob van der Goot, JinYeong Bak, Max Müller-Eberstein, Wei Xu, Alan Ritter, Tim Baldwin
Venues:
WNUT | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
68–78
Language:
URL:
https://aclanthology.org/2024.wnut-1.7
DOI:
Bibkey:
Cite (ACL):
Tyler Bikaun, Melinda Hodkiewicz, and Wei Liu. 2024. MaintNorm: A corpus and benchmark model for lexical normalisation and masking of industrial maintenance short text. In Proceedings of the Ninth Workshop on Noisy and User-generated Text (W-NUT 2024), pages 68–78, San Ġiljan, Malta. Association for Computational Linguistics.
Cite (Informal):
MaintNorm: A corpus and benchmark model for lexical normalisation and masking of industrial maintenance short text (Bikaun et al., WNUT-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.wnut-1.7.pdf
Video:
 https://aclanthology.org/2024.wnut-1.7.mp4