Yinda Chen
Author directory2026
VLA-Trace: Diagnosing Vision-Language-Action Models through Representation and Behavior Tracing
Haoyuan Shi | Xiancong Ren | Yingji Zhang | Qinfan Zhang | Jiayu Hu | Haozhe Shan | Han Dong | Jinpeng Lu | Yinda Chen | Yi Zhang | Yong Dai | Xiaozhu Ju
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Haoyuan Shi | Xiancong Ren | Yingji Zhang | Qinfan Zhang | Jiayu Hu | Haozhe Shan | Han Dong | Jinpeng Lu | Yinda Chen | Yi Zhang | Yong Dai | Xiaozhu Ju
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Understanding how Vision-Language-Action (VLA) models transform multimodal knowledge into embodied control remains an open challenge. We present VLA-Trace, a progressive diagnostic framework that analyzes VLA models through a unified evidence chain from representation dynamics to causal control attribution and behavioral manifestation. It specifically combines cross-modal and checkpoint-drift centered kernel alignment (CKA) to trace representation evolution, attention knockout interventions to identify modality-specific control pathways, and rollout-level behavioral probes to examine grounding, shortcut dependence, and semantic following. Experiments on 𝜋0.5 and OpenVLA reveal three key findings. First, the two models exhibit distinct modality-specific adaptation dynamics during VLA finetuning. Second, they rely on different multimodal routing strategies and layer-wise dependencies during action decoding. Third, although VLA policies excel at visually grounded trajectory generation, they remain limited in fine-grained semantic following. These findings highlight future directions for representation-preserving adaptation, causal VLA circuits, and compositional semantic control.
2025
Can Medical Vision-Language Pre-training Succeed with Purely Synthetic Data?
Che Liu | Zhongwei Wan | Haozhe Wang | Yinda Chen | Talha Qaiser | Chen Jin | Nikolay Burlutskiy | Fariba Yousefi | Rossella Arcucci
Findings of the Association for Computational Linguistics: ACL 2025
Che Liu | Zhongwei Wan | Haozhe Wang | Yinda Chen | Talha Qaiser | Chen Jin | Nikolay Burlutskiy | Fariba Yousefi | Rossella Arcucci
Findings of the Association for Computational Linguistics: ACL 2025
Medical Vision-Language Pre-training (MedVLP) has made significant progress in enabling zero-shot tasks for medical image understanding. However, training MedVLP models typically requires large-scale datasets with paired, high-quality image-text data, which are scarce in the medical domain. Recent advancements in Large Language Models (LLMs) and diffusion models have made it possible to generate large-scale synthetic image-text pairs. This raises the question: Can MedVLP succeed using purely synthetic data? To address this, we use off-the-shelf generative models to create synthetic radiology reports and paired Chest X-ray (CXR) images, and propose an automated pipeline to build a diverse, high-quality synthetic dataset, enabling a rigorous study that isolates model and training settings, focusing entirely from the data perspective.Our results show that MedVLP models trained exclusively on synthetic data outperform those trained on real data by 3.8% in averaged AUC on zero-shot classification. Moreover, using a combination of synthetic and real data leads to a further improvement of 9.07%. Additionally, MedVLP models trained on synthetic or mixed data consistently outperform those trained on real data in zero-shot grounding, as well as in fine-tuned classification and segmentation tasks.Our analysis suggests MedVLP trained on well-designed synthetic data can outperform models trained on real datasets, which may be limited by low-quality samples and long-tailed distributions[^1].[^1]: All data and code will be released upon acceptance.