Public Scientific-Figure Adaptation for AstroCLIMB with a 4B Vision–Language Model

Irving Ernesto Quezada Ramírez


Abstract
We adapt Qwen3.5-4B to the AstroCLIMB task, which asks whether two scientific figures or captions come from the same figure, the same paper, citation-linked papers, or unrelated papers. For caption–image pairs, we first adapt the model on 80,000 public pairs labeled automatically from figure, paper, and citation structure in the public corpus, then train on gold data. Across three gold-training seeds that share one public checkpoint, this initialization improves caption–image development macro-F1 by 0.067 on average over gold-only training under matched gold schedules, although with more total compute. Answer generation and the reinforcement-learning variants we tested do not beat the classifier. The combined system of three modality-specific classifiers reaches a pooled development macro-F1 of 0.756 and a Kaggle leaderboard score of 0.751. Repeated development selection and earlier project exposure to competition materials confine these findings to the evaluated setting, and we document both.
Anthology ID:
2026.wasp-1.17
Volume:
Proceedings of the 4th Workshop on Artificial Intelligence for Scientific Publications
Month:
November
Year:
2026
Address:
Hengqin, Zhuhai, China
Editors:
Alberto Accomazzi, Tirthankar Ghosal, Felix Grezes, Kelly Lockhart, Atilla Kaan Alkan
Venues:
WASP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
154–165
Language:
URL:
https://aclanthology.org/2026.wasp-1.17/
DOI:
Bibkey:
Cite (ACL):
Irving Ernesto Quezada Ramírez. 2026. Public Scientific-Figure Adaptation for AstroCLIMB with a 4B Vision–Language Model. In Proceedings of the 4th Workshop on Artificial Intelligence for Scientific Publications, pages 154–165, Hengqin, Zhuhai, China. Association for Computational Linguistics.
Cite (Informal):
Public Scientific-Figure Adaptation for AstroCLIMB with a 4B Vision–Language Model (Ramírez, WASP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wasp-1.17.pdf