Haolin Yang
Author directoryOther people with similar names: Haolin Yang
Unverified author pages with similar names: Haolin Yang
2026
Towards Anticipatory Agents for Streaming Video Understanding
Haolin Yang | Feilong Tang | Lingxiao Zhao | Xinlin Zhuang | Yifan Lu | Xiang An | Ming Hu | Xiaofeng Zhang | Abdalla Swikir | Junjun He | Zongyuan Ge | Muhammad Haris Khan | Imran Razzak
Findings of the Association for Computational Linguistics: EMNLP 2026
Haolin Yang | Feilong Tang | Lingxiao Zhao | Xinlin Zhuang | Yifan Lu | Xiang An | Ming Hu | Xiaofeng Zhang | Abdalla Swikir | Junjun He | Zongyuan Ge | Muhammad Haris Khan | Imran Razzak
Findings of the Association for Computational Linguistics: EMNLP 2026
Real-time streaming video understanding in domains such as autonomous driving and intelligent surveillance poses challenges beyond conventional offline video processing, requiring continuous perception, proactive decision making, and responsive interaction based on dynamically evolving visual content. However, existing methods rely on alternating perception-reaction or asynchronous triggers, lacking task-driven planning and future anticipation, which limits their real-time responsiveness and proactive decision making in evolving video streams. To this end, we propose a StreamAgent that anticipates the temporal intervals and spatial regions expected to contain future task-relevant information to enable proactive and goal-driven responses. Specifically, we integrate question semantics and historical observations through prompting the anticipatory agent to anticipate the temporal progression of key events, align current observations with the expected future evidence, and subsequently adjust the perception action (e.g., attending to task-relevant regions or continuously tracking in subsequent frames). To enable efficient inference, we design a streaming KV-cache memory mechanism that constructs a hierarchical memory structure for selective recall of relevant tokens, enabling efficient semantic retrieval while reducing the overhead of storing all tokens in the traditional KV-cache. Extensive experiments on streaming and long video understanding tasks demonstrate that our method outperforms existing methods in response accuracy and real-time efficiency, highlighting its practical value for real-world streaming scenarios.
APEX: Learning Adaptive Priorities for Multi-Objective Alignment in Vision-Language Generation
Dongliang Chen | Xinlin Zhuang | Junjie Xu | Luojian Xie | Zehui Wang | Jiaxi Zhuang | Haolin Yang | Liang Dou | Xiao He | Xingjiao Wu | Ying Qian
Findings of the Association for Computational Linguistics: ACL 2026
Dongliang Chen | Xinlin Zhuang | Junjie Xu | Luojian Xie | Zehui Wang | Jiaxi Zhuang | Haolin Yang | Liang Dou | Xiao He | Xingjiao Wu | Ying Qian
Findings of the Association for Computational Linguistics: ACL 2026
Multi-objective alignment for text-to-image generation is commonly implemented via static linear scalarization, but fixed weights often fail under heterogeneous rewards, leading to optimization imbalance where models overfit high-variance, high-responsiveness objectives (e.g., OCR) while under-optimizing perceptual goals. We identify two mechanistic causes: variance hijacking, where reward dispersion induces implicit reweighting that dominates the normalized training signal, and gradient conflicts, where competing objectives produce opposing update directions and trigger seesaw-like oscillations. We propose APEX (Adaptive Priority-based Efficient X-objective Alignment), which stabilizes heterogeneous rewards with Dual-Stage Adaptive Normalization and dynamically schedules objectives via 𝒫3 Adaptive Priorities that combine learning potential, conflict penalty, and progress need. On Stable Diffusion 3.5, APEX achieves improved Pareto trade-offs across four heterogeneous objectives, with balanced gains of +1.31 PickScore, +0.35 DeQA, and +0.53 Aesthetics while maintaining competitive OCR accuracy, mitigating the instability of multi-objective alignment.