2026

While Vision-Language Models (VLMs) have demonstrated strong capabilities in general multimodal tasks, they face significant challenges in low-resource, cross-temporal settings such as ancient Chinese documents, where models must overcome complex visual noise and leverage deep linguistic priors. The functional organization of task-relevant components in existing VLMs remains understudied from a computational interpretability perspective. To address this, we introduce AncientVision-3T, an intervention-oriented diagnostic benchmark designed for mechanistic interpretability experiments on VLMs, organized across OCR, image classification, and image understanding tasks of increasing abstraction. Based on this benchmark, we propose the Ancient Chinese Target-Conditioned Gradient-based Neuron analysis framework (AC-TCGN), which identifies and validates task-relevant neurons for dissecting functional organization in general and domain-specific VLMs. Our experiments demonstrate that AC-TCGN effectively identifies neurons that are critical for model predictions. Moreover, our experimental results reveal a transition from separation to entanglement in the functional organization of decoder feed-forward networks: general VLMs show stronger task-wise separability, whereas the ancient Chinese domain-specific VLM shows greater cross-task neuron sharing and reduced task-wise separability. This suggests enhanced coupling between visual form and historical-semantic processing in ancient Chinese document image-text tasks.