Zhaolong Shen
Author directory2026
TwinBrainVLA: Unleashing the Potential of Generalist VLMs for Embodied Tasks via Asymmetric Mixture-of-Transformers
Bin Yu | Shijie Lian | Xiaopeng Lin | Zhaolong Shen | Changti Wu | Yuzhuo Miao | Xinming Wang | Bailing Wang | Cong Huang | Kai Chen
Findings of the Association for Computational Linguistics: EMNLP 2026
Bin Yu | Shijie Lian | Xiaopeng Lin | Zhaolong Shen | Changti Wu | Yuzhuo Miao | Xinming Wang | Bailing Wang | Cong Huang | Kai Chen
Findings of the Association for Computational Linguistics: EMNLP 2026
Vision-Language-Action (VLA) models are built on the premise that pre-trained Vision-Language Models (VLMs) can supply general semantic understanding ability for embodied tasks. However, we find that robotic fine-tuning can severely erode this capability: VQA benchmarks and layer-wise CKA analysis reveal rapid representational drift, and co-training with general vision-language data does not prevent the collapse. We propose TwinBrainVLA, an asymmetric dual-stream VLA that keeps a pre-trained "Left Brain" strictly frozen as a semantic generalist while training a "Right Brain" as an embodied control specialist. Its Asymmetric Mixture-of-Transformers (AsyMoT) mechanism lets the Right Brain query frozen Left-Brain key-value representations at every transformer layer, integrating intact semantic knowledge without corrupting it. Across SimplerEnv, RoboCasa, LIBERO, and real-robot experiments, TwinBrainVLA outperforms strong baselines and large-scale embodied models, achieving a 14.3% improvement on SimplerEnv and a 2.7× gain in physical-robot instruction generalization.
FrameSkip: Learning from Fewer but More Informative Frames in VLA Training
Bin Yu | Shijie Lian | Xiaopeng Lin | Zhaolong Shen | Yuliang Wei | Changti Wu | Hang Yuan | Haishan Liu | Bailing Wang | Cong Huang | Kai Chen
Findings of the Association for Computational Linguistics: EMNLP 2026
Bin Yu | Shijie Lian | Xiaopeng Lin | Zhaolong Shen | Yuliang Wei | Changti Wu | Hang Yuan | Haishan Liu | Bailing Wang | Cong Huang | Kai Chen
Findings of the Association for Computational Linguistics: EMNLP 2026
Vision-Language-Action (VLA) policies are commonly trained from dense robot demonstration trajectories, often collected through teleoperation, by sampling every recorded frame as if it provided equally useful supervision. We argue that this convention creates a temporal supervision imbalance: long low-change segments dominate the training stream, while manipulation-critical transitions such as alignment, contact, grasping, and release appear only sparsely. We introduce FrameSkip, a data-layer frame selection framework that scores trajectory frames using action variation, visual-action coherence, task-progress priors, and gripper-transition preservation, then remaps training samples toward high-importance frames under a target retention ratio. Because FrameSkip operates only in the dataloader, it leaves the VLA architecture, action head, training objective, and inference procedure unchanged. Across RoboCasa-GR1, SimplerEnv, and LIBERO, FrameSkip improves the success-retention trade-off over full-frame training and simpler frame selection variants, achieving a macro-average success rate of 76.15% across the three benchmarks compared with 66.50% for full-frame training while using a compressed trajectory view that retains 20% of unique frames in the main setting.
RoboSemanticBench: Diagnosing Semantic Grounding in Action Prediction for VLA Models
Bin Yu | Yao Zhang | Haishan Liu | Shijie Lian | Yuliang Wei | Xiaopeng Lin | Zhaolong Shen | Changti Wu | Ruina Hu | Bailing Wang | Cong Huang | Kai Chen
Findings of the Association for Computational Linguistics: EMNLP 2026
Bin Yu | Yao Zhang | Haishan Liu | Shijie Lian | Yuliang Wei | Xiaopeng Lin | Zhaolong Shen | Changti Wu | Ruina Hu | Bailing Wang | Cong Huang | Kai Chen
Findings of the Association for Computational Linguistics: EMNLP 2026
Vision-language-action (VLA) models are built on the premise that semantic understanding from pretrained language or vision-language backbones should guide robot action prediction. Yet robot fine-tuning is optimized as imitation over task-specific action distributions, and many evaluations can be solved through visual or instruction-action shortcuts. We introduce **RoboSemanticBench (RSB)**, an embodied benchmark for diagnosing semantic grounding in action prediction: whether post-trained VLA models can use complex instruction semantics to select and manipulate the correct physical target. In each episode, a robot receives a multiple-choice math or general-knowledge question, observes candidate answer blocks, and must grasp the block corresponding to the correct answer. RSB covers controlled arithmetic, grade-school mathematical understanding, and commonsense or factual understanding under four-choice and ten-choice suites. Across representative VLA models, we find that many policies learn to grasp candidate blocks but select the semantically correct block at near-random or below-random rates after controlling for grasp success, revealing a persistent gap between backbone-level semantic competence and action prediction.
IntentVLA: Short-Horizon Intent Modeling for Aliased Robot Manipulation
Shijie Lian | Bin Yu | Xiaopeng Lin | Zhaolong Shen | Laurence Tianruo Yang | Yurun Jin | Haishan Liu | Changti Wu | Hang Yuan | Cong Huang | Kai Chen
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Shijie Lian | Bin Yu | Xiaopeng Lin | Zhaolong Shen | Laurence Tianruo Yang | Yurun Jin | Haishan Liu | Changti Wu | Hang Yuan | Cong Huang | Kai Chen
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Robot imitation data are often multimodal: similar visual-language observations may be followed by different action chunks because human demonstrators act with different short-horizon intents, task phases, or recent context. Existing frame-conditioned VLA policies infer each chunk from the current observation and instruction alone, so under partial observability they may resample different intents across adjacent replanning steps, leading to inter-chunk conflict and unstable execution. We introduce IntentVLA, a history-conditioned VLA framework that encodes recent visual observations into a compact short-horizon intent representation and uses it to condition chunk generation. We further introduce AliasBench, a 12-task ambiguity-aware benchmark on RoboTwin2 with matched training data and evaluation environments that isolate short-horizon observation aliasing. Across AliasBench, SimplerEnv, LIBERO, and RoboCasa, IntentVLA improves rollout stability and outperforms strong VLA baselines.