Increasing Robustness for Cross-domain Dialogue Act Classification on Social Media Data

Marcus Vielsted, Nikolaj Wallenius, Rob van der Goot


Abstract
Automatically detecting the intent of an utterance is important for various downstream natural language processing tasks. This task is also called Dialogue Act Classification (DAC) and was primarily researched on spoken one-to-one conversations. The rise of social media has made this an interesting data source to explore within DAC, although it comes with some difficulties: non-standard form, variety of language types (across and within platforms), and quickly evolving norms. We therefore investigate the robustness of DAC on social media data in this paper. More concretely, we provide a benchmark that includes cross-domain data splits, as well as a variety of improvements on our transformer-based baseline. Our experiments show that lexical normalization is not beneficial in this setup, balancing the labels through resampling is beneficial in some cases, and incorporating context is crucial for this task and leads to the highest performance improvements 7 F1 percentage points in-domain and 20 cross-domain).
Anthology ID:
2022.wnut-1.20
Volume:
Proceedings of the Eighth Workshop on Noisy User-generated Text (W-NUT 2022)
Month:
October
Year:
2022
Address:
Gyeongju, Republic of Korea
Venue:
WNUT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
180–193
Language:
URL:
https://aclanthology.org/2022.wnut-1.20
DOI:
Bibkey:
Cite (ACL):
Marcus Vielsted, Nikolaj Wallenius, and Rob van der Goot. 2022. Increasing Robustness for Cross-domain Dialogue Act Classification on Social Media Data. In Proceedings of the Eighth Workshop on Noisy User-generated Text (W-NUT 2022), pages 180–193, Gyeongju, Republic of Korea. Association for Computational Linguistics.
Cite (Informal):
Increasing Robustness for Cross-domain Dialogue Act Classification on Social Media Data (Vielsted et al., WNUT 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.wnut-1.20.pdf
Code
 marcusvielsted/dialogueactclassification