The Software Mention Detection and Coreference Resolution Shared Task 2026

Sharmila Upadhyaya, Wolfgang Otto, Julia Matela, Frank Krüger, Stefan Dietze


Abstract
Software is referenced in research papers in many different ways: full names, abbreviations, misspellings, versioned names, or indirect references via websites and citations. This makes it hard to link mentions to a single software entity, which in turn limits large-scale analyses and knowledge graph construction. The Software Mention Detection and Coreference Resolution (SOMD) shared task 2026, organized at the Natural Scientific Language Processing (NSLP) workshop at LREC 2026, focuses on clustering software mentions that refer to the same software entity. We provide three subtasks covering gold mentions, automatically extracted mentions, and mentions sampled at scale from large-scale publications. Systems are evaluated with established coreference metrics (MUC, B3, CEAFe) and their CoNLL average. This paper describes the task setup, datasets, evaluation, baseline, and the observed patterns in participant submissions, and outlines future directions for scalable software mention coreference resolution. The shared task was concluded with total five registered participants, with total 43 submissions for all subtasks. Finally, two system papers were submitted with competitive performance against baselines.
Anthology ID:
2026.nslp-1.24
Volume:
Proceedings of Natural Scientific Language Processing (NSLP) @ LREC 2026
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Georg Rehm, Stefan Dietze, Danilo Dessi, Diana Maynard, Sonja Schimmler
Venues:
NSLP | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
247–254
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-nslp-24
DOI:
10.63317/3koortigjkfr
Bibkey:
Cite (ACL):
Sharmila Upadhyaya, Wolfgang Otto, Julia Matela, Frank Krüger, and Stefan Dietze. 2026. The Software Mention Detection and Coreference Resolution Shared Task 2026. In Proceedings of Natural Scientific Language Processing (NSLP) @ LREC 2026, pages 247–254, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
The Software Mention Detection and Coreference Resolution Shared Task 2026 (Upadhyaya et al., NSLP 2026)
Copy Citation: