Yuhang He
Author directoryOther people with similar names: Yuhang He (Xi'an Jiaotong), Yuhang He (Harbin, HKUST (Guangzhou))
2026
ReVision: Scaling Computer-Use Agents via Temporal Visual Redundancy Reduction
Amirhossein Abaskohi | Yuhang He | Peter West | Giuseppe Carenini | Pranit Chawla | Vibhav Vineet
Findings of the Association for Computational Linguistics: EMNLP 2026
Amirhossein Abaskohi | Yuhang He | Peter West | Giuseppe Carenini | Pranit Chawla | Vibhav Vineet
Findings of the Association for Computational Linguistics: EMNLP 2026
Computer-use agents (CUAs) rely on visual observations of graphical user interfaces, where each screenshot is encoded into a large number of visual tokens. As interaction trajectories grow, the token cost increases rapidly, limiting the amount of history that can be incorporated under fixed context and compute budgets. This has resulted in no or very limited improvement in the performance when using history unlike other domains. We address this inefficiency by introducing ReVision, which is used to train multimodal language models on trajectories where redundant visual patches are removed using a learned patch selector that compares patch representations across consecutive screenshots while preserving spatial structure required by the model. Across three benchmarks, OSWorld, WebTailBench, and AgentNetBench, when processing trajectories with 5 history screenshots using Qwen2.5-VL-7B, ReVision reduces token usage by 46% on average while improving success rate by 3% over the no drop baseline. This establishes a clear efficiency gain, enabling agents to process longer trajectories with fewer tokens. With this improved efficiency, we revisit the role of history in CUAs and find that performance continues to improve as more past observations are incorporated when redundancy is removed.
OS-Marathon: Benchmarking Computer-Use Agents on Vast-Horizon, Repetitive Tasks
Jing Wu | Wenjie Ai | Daphne Barretto | Yiye Chen | Qingyu Chen | Yuhang He | Pranit Chawla | Nicholas Gydé | Yanan Jian | Vibhav Vineet
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Jing Wu | Wenjie Ai | Daphne Barretto | Yiye Chen | Qingyu Chen | Yuhang He | Pranit Chawla | Nicholas Gydé | Yanan Jian | Vibhav Vineet
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Vast-horizon, repetitive workflows are common in daily routines, e.g., processing expense reports from a stack of receipts, organising a collection of PDF annotations into structured notes, and are tedious for humans, with execution length scaling with the volume of data to process. They are, however, well-suited to autonomous agents, since their structured, recurring sub-workflows follow a logic that can be systematically learned. Yet no existing benchmark evaluates agents specifically on vast-horizon repetitive capabilities, leaving the problem largely underexplored. To bridge this gap, we establish OS-Marathon, comprising 100 vast-horizon repetitive tasks across 5 scenarios and 10 domains, on which our evaluation reveals that leading state-of-the-art (SOTA) CUAs struggle substantially. We further find that introducing a task orchestrator to decompose the workflow into per-instance subtasks fails to mitigate the difficulty: errors accumulate and propagate across solver agents, indicating that naive decomposition is insufficient for these tasks. We then explore a cost-effective personalisation strategy, i.e. GraphDemo, that adapts general agents to such tasks from a single human demonstration of the recurring sub-workflow logic. Extensive experiments show both the real-world challenge of vast-horizon repetitive tasks and the improvement provided by human demonstration in this setting.
2025
RiTTA: Modeling Event Relations in Text-to-Audio Generation
Yuhang He | Yash Jain | Xubo Liu | Andrew Markham | Vibhav Vineet
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Yuhang He | Yash Jain | Xubo Liu | Andrew Markham | Vibhav Vineet
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Existing text-to-audio (TTA) generation methods have neither systematically explored audio event relation modeling, nor proposed any new framework to enhance this capability. In this work, we systematically study audio event relation modeling in TTA generation models. We first establish a benchmark for this task by: (1) proposing a comprehensive relation corpus covering all potential relations in real-world scenarios; (2) introducing a new audio event corpus encompassing commonly heard audios; and (3) proposing new evaluation metrics to assess audio event relation modeling from various perspectives. Furthermore, we propose a gated prompt tuning strategy that improves existing TTA models’ relation modeling capability with negligible extra parameters. Specifically, we introduce learnable relation and event prompt that append to the text prompt before feeding to existing TTA models.