Thorny Roses: Investigating the Dual Use Dilemma in Natural Language Processing

Lucie-Aimée Kaffee, Arnav Arora, Zeerak Talat, Isabelle Augenstein


Abstract
Dual use, the intentional, harmful reuse of technology and scientific artefacts, is an ill-defined problem within the context of Natural Language Processing (NLP). As large language models (LLMs) have advanced in their capabilities and become more accessible, the risk of their intentional misuse becomes more prevalent. To prevent such intentional malicious use, it is necessary for NLP researchers and practitioners to understand and mitigate the risks of their research. Hence, we present an NLP-specific definition of dual use informed by researchers and practitioners in the field. Further, we propose a checklist focusing on dual-use in NLP, that can be integrated into existing conference ethics-frameworks. The definition and checklist are created based on a survey of NLP researchers and practitioners.
Anthology ID:
2023.findings-emnlp.932
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2023
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
13977–13998
Language:
URL:
https://aclanthology.org/2023.findings-emnlp.932
DOI:
10.18653/v1/2023.findings-emnlp.932
Bibkey:
Cite (ACL):
Lucie-Aimée Kaffee, Arnav Arora, Zeerak Talat, and Isabelle Augenstein. 2023. Thorny Roses: Investigating the Dual Use Dilemma in Natural Language Processing. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 13977–13998, Singapore. Association for Computational Linguistics.
Cite (Informal):
Thorny Roses: Investigating the Dual Use Dilemma in Natural Language Processing (Kaffee et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-emnlp.932.pdf