TRACS: Telescope Reference Astronomy Categorization Dataset and Shared Task

Felix Grezes, Kelly Lockhart, Alberto Accomazzi, Jennifer Lynn Bartlett, Ethan Seefried, Anjali Pandiri, Tirthankar Ghosal


Abstract
To assess the scientific impact of observational facilities, Astronomers analyze publications which have made use of the data by the facility. This requires bibliographies annotating and linking data products with the literature, allowing bibliometrics to measure impact of the data. Creating bibliographies is laborious, involves specialists searching the literature for names, acronyms and identifiers, then determining how/if observations were used in those publications.

These bibliographies are useful beyond metrics: from the perspective of a research scientist, the data-literature connections provide a critical path to data discovery and access. Thus, by leveraging the efforts of librarians and archivists, we can use telescope bibliographies to support the scientific inquiry process. To this end, we introduce the TRACS: Telescope Reference and Astronomy Categorization dataset and Shared task, consisting of over 89K public English texts from space telescope bibliographies, categorized using a new, simple taxonomy based on discussion with established bibliographers.

We hope TRACS will be used to train modern Machine Learning and Artificial Intelligence models that in turn will help data curators build bibliographies. We evaluate how off-the-shelf Large Language Models perform on automatic bibliography curation as a baseline analysis. Results show the difficulty of the task and the need for custom tools.
Anthology ID:
2026.wasp-1.16
Volume:
Proceedings of the 4th Workshop on Artificial Intelligence for Scientific Publications
Month:
November
Year:
2026
Address:
Hengqin, Zhuhai, China
Editors:
Alberto Accomazzi, Tirthankar Ghosal, Felix Grezes, Kelly Lockhart, Atilla Kaan Alkan
Venues:
WASP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
142–153
Language:
URL:
https://aclanthology.org/2026.wasp-1.16/
DOI:
Bibkey:
Cite (ACL):
Felix Grezes, Kelly Lockhart, Alberto Accomazzi, Jennifer Lynn Bartlett, Ethan Seefried, Anjali Pandiri, and Tirthankar Ghosal. 2026. TRACS: Telescope Reference Astronomy Categorization Dataset and Shared Task. In Proceedings of the 4th Workshop on Artificial Intelligence for Scientific Publications, pages 142–153, Hengqin, Zhuhai, China. Association for Computational Linguistics.
Cite (Informal):
TRACS: Telescope Reference Astronomy Categorization Dataset and Shared Task (Grezes et al., WASP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wasp-1.16.pdf