Qingyun Li

Author directory

2026

While Vision-Language Models (VLMs) have significantly advanced Computer-Using Agents (CUAs), current agentic frameworks struggle with robustness in novel domains and long-horizon workflows due to the absence of visual-aware tutorial retrieval and the lack of granular control over historical visual context curation and pruning. To bridge these gaps, we introduce OS-Symphony, a holistic framework that comprises an Orchestrator coordinating two key innovations for robust automation: (1) a Reflection-Memory Agent that utilizes milestone-driven long-term memory to enable trajectory-level self-correction, effectively mitigating visual context loss in long-horizon tasks; (2) Versatile Tool Agents featuring a Multimodal Searcher that adopts a “SeeAct” paradigm to navigate a browser-based sandbox to synthesize live, visually aligned tutorials, thereby resolving fidelity issues in unseen scenarios. Experimental results demonstrate that OS-Symphony delivers substantial performance gains across varying model scales, establishing new state-of-the-art results on three online benchmarks, notably achieving 65.84% on OSWorld. All research assets will be made publicly available.
Language models often appear to become insensitive to how text is tokenized. Models trained with different tokenizers can reach similar language-modeling loss, and prior work shows that they recover word-level information from the raw subword segmentations (a phenomenon referred to as "detokenization"). This raises a natural question: once that information has been recovered, do the resulting hidden states become independent of the tokenizer that produced them? We study this using *tokenizer twins*, pairs of models matched in architecture, training data, and random seed but trained with different tokenizers. We learn small translators between their hidden states at positions where the two tokenizers agree, and then test the same mapping where their tokenization paths differ. Transfer works well at agreement positions, adding less than one nat of loss, but breaks sharply at disagreement positions, where the loss increases by more than seven nats. This gap appears from the first hidden layer and persists through the network. At the same time, word-identity probes can still recover much of the underlying content from these representations. In other words, language models can abstract beyond their individual subword tokens while still carrying a lasting imprint of how the text was tokenized.