VLA Grounder: Language-Conditioning Space Optimization for Black-Box VLA Models

Damir Shodiev, Nikita Kachaev, Alexey Kovalev, Aleksandr Panov, Aleksei Staroverov


Abstract
Vision-Language-Action (VLA) models are commonly treated as end-to-end action policies conditioned on natural-language task descriptions. In practice, however, their behavior often depends sharply on how the instruction is phrased, suggesting that language is not merely a task label but an optimizable conditioning input. We study whether frozen VLA policies can be improved by optimizing language space rather than updating action weights. Our method introduces a language-conditioning space policy that translates a human instruction into a short VLA-grounded command using object appearance, spatial relations, and target-grounding cues. The language-conditioning space policy is optimized with reinforcement learning from sparse task-completion rewards, while the downstream VLA remains fully frozen. Experiments on RL4VLA and VL-Think show that language-conditioning space optimization improves success on instruction-sensitive, symbolic, and multi-object manipulation tasks, demonstrating that language can serve as an optimizable variable for a robot foundation models.
Anthology ID:
2026.emnlp-main.1791
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
40818–40833
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1791/
DOI:
Bibkey:
Cite (ACL):
Damir Shodiev, Nikita Kachaev, Alexey Kovalev, Aleksandr Panov, and Aleksei Staroverov. 2026. VLA Grounder: Language-Conditioning Space Optimization for Black-Box VLA Models. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 40818–40833, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
VLA Grounder: Language-Conditioning Space Optimization for Black-Box VLA Models (Shodiev et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1791.pdf