Beyond Visual Similarity: Parameter-Efficient Vision–Language Models for Scientific Citation Linking on AstroCLIMB

Ashmani Kumar, Shubham Sharma, K S Ramalakshmi, Ankush Chopra


Abstract
This paper describes our submission to the AstroCLIMB shared task, which evaluates whether multimodal models can identify citation relationships among astronomy papers from pairs of figures and captions. We explore an empirical progression spanning frozen embedding baselines, dual encoders, cross-encoders, and generative vision–language models (VLMs) adapted via parameter-efficient fine-tuning (LoRA with 4-bit quantization). Among our evaluated configurations, a fine-tuned Qwen3.8-27B achieves a test Macro-F1 of approximately 0.74. An auxiliary specialist adapter trained to re-rank the frequently confused same paper and related papers classes yields comparable performance within expected run-to-run variance. Across input modalities, Text–Text pairs achieve the highest classification accuracy, followed by Text–Figure pairs, while Figure–Figure pairs prove the most challenging. These findings demonstrate that visual similarity alone remains an insufficient proxy for semantic citation linkage in specialized scientific literature.
Anthology ID:
2026.wasp-1.23
Volume:
Proceedings of the 4th Workshop on Artificial Intelligence for Scientific Publications
Month:
November
Year:
2026
Address:
Hengqin, Zhuhai, China
Editors:
Alberto Accomazzi, Tirthankar Ghosal, Felix Grezes, Kelly Lockhart, Atilla Kaan Alkan
Venues:
WASP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
210–215
Language:
URL:
https://aclanthology.org/2026.wasp-1.23/
DOI:
Bibkey:
Cite (ACL):
Ashmani Kumar, Shubham Sharma, K S Ramalakshmi, and Ankush Chopra. 2026. Beyond Visual Similarity: Parameter-Efficient Vision–Language Models for Scientific Citation Linking on AstroCLIMB. In Proceedings of the 4th Workshop on Artificial Intelligence for Scientific Publications, pages 210–215, Hengqin, Zhuhai, China. Association for Computational Linguistics.
Cite (Informal):
Beyond Visual Similarity: Parameter-Efficient Vision–Language Models for Scientific Citation Linking on AstroCLIMB (Kumar et al., WASP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wasp-1.23.pdf