From Astronomical Circulars to Auditable Follow-up Records: Schema-Constrained LLM Extraction with Human Verification

Fabian Schüssler, Sofia Bisero, M. Cellier, J. Cinosi, A. Ciric, Bernardo Cornejo, Ilja Jaroschewski, Atilla Kaan Alkan, R. Weizmann Kiendrebeogo, A. Saint-Paul


Abstract
GCN Circulars distribute crucial information on astronomical observations of transient phenomena, but their flexible prose mixes observations, limits, metadata, contacts, and interpretation. We present an auditable pipeline that converts these reports into event-linked, structured records. Regular expressions provide domain hints; a large language model returns strict schema-constrained JSON; deterministic stages normalize values and emit review flags. Seven domain reviewers assessed 231 outputs from 210 distinct Circulars, fully confirming 223 reports and marking eight partly correct. They confirmed 25,827 of 25,880 definite field decisions (99.80%); errors concentrated in timing and facility attribution. Comparison with independent redshift datasets found semantic catalog disagreements but no values misread by our pipeline. Applied to the GCN Circular archive back to 2016, the pipeline has structured 26,811 reports into 68,393 observations, now served in real time by the Astro-COLIBRI platform. We release the extraction pipeline as an open-source package and the derived records as a continuously updated resource.
Anthology ID:
2026.wasp-1.3
Volume:
Proceedings of the 4th Workshop on Artificial Intelligence for Scientific Publications
Month:
November
Year:
2026
Address:
Hengqin, Zhuhai, China
Editors:
Alberto Accomazzi, Tirthankar Ghosal, Felix Grezes, Kelly Lockhart, Atilla Kaan Alkan
Venues:
WASP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
17–22
Language:
URL:
https://aclanthology.org/2026.wasp-1.3/
DOI:
Bibkey:
Cite (ACL):
Fabian Schüssler, Sofia Bisero, M. Cellier, J. Cinosi, A. Ciric, Bernardo Cornejo, Ilja Jaroschewski, Atilla Kaan Alkan, R. Weizmann Kiendrebeogo, and A. Saint-Paul. 2026. From Astronomical Circulars to Auditable Follow-up Records: Schema-Constrained LLM Extraction with Human Verification. In Proceedings of the 4th Workshop on Artificial Intelligence for Scientific Publications, pages 17–22, Hengqin, Zhuhai, China. Association for Computational Linguistics.
Cite (Informal):
From Astronomical Circulars to Auditable Follow-up Records: Schema-Constrained LLM Extraction with Human Verification (Schüssler et al., WASP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wasp-1.3.pdf