F*ck Around and Find Out: Quasi-Malicious Interactions with LLMs as a Site of Situated Learning

Sarah ONeill


Abstract
This work-in-progress paper proposes a cross-disciplinary perspective on “malicious” interactions with large language models (LLMs), reframing it from only a threat to be mitigated, we ask whether certain adversarial interactions can also serve as productive learning encounters that demystify the opaque workings of AI systems to novice users. We ground this inquiry in an anecdotal observation of a student who deliberately sabotaged a machine-learning robot’s training process in order to understand its underlying logic. We outline this observation with a conceptual framework for learning with, through, and from the material quirks of LLMs grounded in Papert’s constructionism and Hasse’s ultra-social learning theory. Finally, we present the preliminary design of a research-through-workshop where non-experts will jailbreak various LLM chatbots, investigating this encounter as a situated learning process. We share this early-stage research as an invitation for feedback on reimagining inappropriate and harmful interactions with LLMs not merely as problems, but as opportunities for engagement and education.
Anthology ID:
2025.ommm-1.6
Volume:
Proceedings of Interdisciplinary Workshop on Observations of Misunderstood, Misguided and Malicious Use of Language Models
Month:
September
Year:
2025
Address:
Varna, Bulgaria
Editors:
Piotr Przybyła, Matthew Shardlow, Clara Colombatto, Nanna Inie
Venues:
OMMM | WS
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
53–58
Language:
URL:
https://aclanthology.org/2025.ommm-1.6/
DOI:
Bibkey:
Cite (ACL):
Sarah ONeill. 2025. F*ck Around and Find Out: Quasi-Malicious Interactions with LLMs as a Site of Situated Learning. In Proceedings of Interdisciplinary Workshop on Observations of Misunderstood, Misguided and Malicious Use of Language Models, pages 53–58, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
F*ck Around and Find Out: Quasi-Malicious Interactions with LLMs as a Site of Situated Learning (ONeill, OMMM 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.ommm-1.6.pdf