Li Xu
Author directory2026
DYNAMO: Dynamic Skill-Tool Evolution for Vision-Language Agents
Yutao Sun | Yanting Miao | Hao-Xuan Ma | Mengyu Zhou | Mingshuai Chen | Tiancheng Zhao | Dexin Wang | Lei Lv | Li Xu | Xiaoxi Jiang | Guanjun Jiang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yutao Sun | Yanting Miao | Hao-Xuan Ma | Mengyu Zhou | Mingshuai Chen | Tiancheng Zhao | Dexin Wang | Lei Lv | Li Xu | Xiaoxi Jiang | Guanjun Jiang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Improving vision-language models (VLMs) on visual reasoning typically requires retraining or hand-designed prompts and tools. We present Dynamo, a training-free framework that adapts a frozen VLM without any weight updates. On a small labeled training subset, the agent inspects its own correct and incorrect attempts and evolves two complementary capabilities: reusable reasoning skills for cognitive bottlenecks, and executable visual tools for perceptual ones. Each generated tool is paired with a skill that specifies when to invoke it, and both capability types accumulate in a persistent library. Across four visual reasoning benchmarks and five VLM backbones, Dynamo improves direct inference on all 20 model–benchmark settings (avg. +5.6 acc). When the tool set is given in advance, the framework learns when to call each tool, and per-step tool choice improves on every tested backbone. Against task-specific RL (VTool-R1, DeepEyes), Dynamo closes 65–99% of the RL gap at a fraction of the compute, and combines additively with RL when available.
2025
QueryAttack: Jailbreaking Aligned Large Language Models Using Structured Non-natural Query Language
Qingsong Zou | Jingyu Xiao | Qing Li | Zhi Yan | Yuhang Wang | Li Xu | Wenxuan Wang | Kuofeng Gao | Ruoyu Li | Yong Jiang
Findings of the Association for Computational Linguistics: ACL 2025
Qingsong Zou | Jingyu Xiao | Qing Li | Zhi Yan | Yuhang Wang | Li Xu | Wenxuan Wang | Kuofeng Gao | Ruoyu Li | Yong Jiang
Findings of the Association for Computational Linguistics: ACL 2025
Recent advances in large language models (LLMs) have demonstrated remarkable potential in the field of natural language processing. Unfortunately, LLMs face significant security and ethical risks. Although techniques such as safety alignment are developed for defense, prior researches reveal the possibility of bypassing such defenses through well-designed jailbreak attacks. In this paper, we propose QueryAttack, a novel framework to examine the generalizability of safety alignment. By treating LLMs as knowledge databases, we translate malicious queries in natural language into structured non-natural query language to bypass the safety alignment mechanisms of LLMs. We conduct extensive experiments on mainstream LLMs, and the results show that QueryAttack not only can achieve high attack success rates (ASRs), but also can jailbreak various defense methods. Furthermore, we tailor a defense method against QueryAttack, which can reduce ASR by up to 64% on GPT-4-1106. Our code is available at https://anonymous.4open.science/r/QueryAttack-334B.