Reflexive Research with LLMs: Considering the Positionality of Users and Systems

Eleanor L.T. Smith, Luis Morgado da Costa, Antske Fokkens


Abstract
Previous work has found that people often perceive computational systems as neutral tools (van Es, 2023), and yet these systems are not developed or deployed within a vacuum. As the popularity of Large Language Models (LLMs) in digital social science and humanities (DSSH) research increases, it is important that we reflect both on our positionality as researchers regarding how we are primed to interact with these systems and the positionality of the systems themselves as defined by their design and training. This paper presents a model of factors and interactions affecting the use of LLMs in DSSH research and argues that explicit discussion of both human biases, which affect how we interact with systems, and the potential biases encoded in systems are needed in conjunction with strong case specific system evaluation when developing methodologically sound applications of LLMs.
Anthology ID:
2026.llms4ssh-1.19
Volume:
Proceedings of Shaping Multilingual, Multimodal AI for the Social Sciences and Humanities (LLMs4SSH) @ LREC 2026
Month:
May
Year:
2026
Address:
Palma de Mallorca (Spain)
Editors:
Arturo Montejo-Raez, Cristina Grisot, Joanna Blochowiak, Nikola Ljubešić, Elena Battaner, German Rigau
Venues:
LLMs4SSH | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
175–186
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-llms4ssh-19
DOI:
10.63317/3ycn8grfuwtx
Bibkey:
Cite (ACL):
Eleanor L.T. Smith, Luis Morgado da Costa, and Antske Fokkens. 2026. Reflexive Research with LLMs: Considering the Positionality of Users and Systems. In Proceedings of Shaping Multilingual, Multimodal AI for the Social Sciences and Humanities (LLMs4SSH) @ LREC 2026, pages 175–186, Palma de Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
Reflexive Research with LLMs: Considering the Positionality of Users and Systems (Smith et al., LLMs4SSH 2026)
Copy Citation: