Xi Xiao
Author directoryOther people with similar names: Xi Xiao
2026
ComfySearch: Autonomous Exploration and Reasoning for ComfyUI Workflows
Jinwei Su | Qizhen Lan | Zeyu Wang | Yinghui Xia | Hairu Wen | Yiqun Duan | Xi Xiao | Yang Jingsong | Lewei He | Tianyu Shi
Findings of the Association for Computational Linguistics: EMNLP 2026
Jinwei Su | Qizhen Lan | Zeyu Wang | Yinghui Xia | Hairu Wen | Yiqun Duan | Xi Xiao | Yang Jingsong | Lewei He | Tianyu Shi
Findings of the Association for Computational Linguistics: EMNLP 2026
AI-generated content has progressed from monolithic models to modular workflows, especially on platforms like ComfyUI, allowing users to customize complex creative pipelines. However, the large number of components in ComfyUI and the difficulty of maintaining long-horizon structural consistency under strict graph constraints frequently lead to low pass rates and workflows of limited quality. To tackle these limitations, we present ComfySearch, an agentic framework that can effectively explore the component space and generate functional ComfyUI pipelines via validation-guided workflow construction. Experiments demonstrate that ComfySearch substantially outperforms existing methods on complex and creative tasks, achieving higher executability (pass) rates, higher solution rates, and stronger generalization.
Dynamic Hub-and-Spoke Memory for Streaming Video Understanding
Xinru Jiang | Lin Zhao | Xi Xiao | Yunbei Zhang | Janet Wang | Chenrui Ma | Haolin Li | Yanzhi Wang | Yifan Gong | Octavia Camps
Findings of the Association for Computational Linguistics: EMNLP 2026
Xinru Jiang | Lin Zhao | Xi Xiao | Yunbei Zhang | Janet Wang | Chenrui Ma | Haolin Li | Yanzhi Wang | Yifan Gong | Octavia Camps
Findings of the Association for Computational Linguistics: EMNLP 2026
Streaming video understanding requires answering questions at arbitrary times over a continuously growing visual stream. The central challenge is to compactly remember long-range history while effectively retrieving question-relevant evidence. We propose Dynamic Hub-and-Spoke Memory (D-HSM), a training-free framework that represents distant history as structured textual memory while preserving the recent frames as visual tokens for fine-grained perception. Specifically, D-HSM turns selected historical video chunks into typed textual observations and stores them in an entity-centered hub-and-spoke memory, with entities as hubs and related evidence as spokes. When answering a question, D-HSM dynamically retrieves a compact question-aware memory subset, expands it through hub-and-spoke links, and combines it with the recent visual window for frozen-VLM answer prediction. Extensive experiments on both streaming and long video benchmarks show that D-HSM consistently and substantially improves VLM backbones and outperforms other state-of-the-art online and offline video understanding baselines.
HyperAdaLoRA: Accelerating LoRA Rank Allocation During Training via Hypernetworks without Sacrificing Performance
Hao Zhang | Zhenjia Li | Yifan Gao | Xi Xiao | Heng Zhang | Shuyang Zhang | Xiaoxincc | Bo Huang | Yuhang Wu | Tianyang Wang | Hao Xu
Findings of the Association for Computational Linguistics: ACL 2026
Hao Zhang | Zhenjia Li | Yifan Gao | Xi Xiao | Heng Zhang | Shuyang Zhang | Xiaoxincc | Bo Huang | Yuhang Wu | Tianyang Wang | Hao Xu
Findings of the Association for Computational Linguistics: ACL 2026
Parameter-Efficient Fine-Tuning (PEFT), especially Low-Rank Adaptation (LoRA), has emerged as a promising approach to fine-tuning large language models(LLMs) while reducing computational and memory overhead. However, LoRA assumes a uniform rank r for each incremental matrix, not accounting for the varying significance of weight matrices across different modules and layers. AdaLoRA leverages Singular Value Decomposition (SVD) to parameterize updates and employs pruning of singular values to introduce dynamic rank allocation, thereby enhancing adaptability. However, during the training process, it often encounters issues of slow convergence speed and high computational overhead. To address this issue, we propose HyperAdaLoRA, a novel framework that accelerates the convergence of AdaLoRA by leveraging a hypernetwork. Instead of directly optimizing the components of Singular Value Decomposition (P, 𝛬, Q), HyperAdaLoRA employs a hypernetwork based on attention mechanisms to dynamically generate these parameters. By pruning the outputs of the hypernetwork that generates the singular values, dynamic rank allocation is achieved. Comprehensive experiments on various datasets and models demonstrate that our method achieves faster convergence without sacrificing performance. Moreover, our method generalizes well to other LoRA-based approaches, highlighting its strong generalization capability.
Not All Directions Matter: Towards Structured and Task-Aware Low-Rank Model Adaptation
Xi Xiao | Chenrui Ma | Yunbei Zhang | Chen Liu | Zhuxuanzi Wang | Yanshu Li | Lin Zhao | Guosheng Hu | Tianyang Wang | Hao Xu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Xi Xiao | Chenrui Ma | Yunbei Zhang | Chen Liu | Zhuxuanzi Wang | Yanshu Li | Lin Zhao | Guosheng Hu | Tianyang Wang | Hao Xu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Low-Rank Adaptation (LoRA) has become a cornerstone of parameter-efficient fine-tuning (PEFT). Yet, its efficacy is hampered by two fundamental limitations: semantic drift, arising from treating all update directions with equal importance, and structural incoherence, due to adapting layers independently, resulting in uncoordinated and suboptimal updates. To address these issues, we propose StructLoRA, a framework that tackles both limitations through a principled dual-component design: (1) an Information Bottleneck-guided filter that prunes task-irrelevant directions to mitigate semantic drift, and (2) a lightweight, training-only graph-based coordinator that enforces inter-layer consistency to resolve structural incoherence. Extensive experiments across large language models, vision language models, and vision models (including LLaMA, LLaVA, and ViT) demonstrate that StructLoRA consistently establishes a new state of the art, outperforming not only vanilla LoRA but also advanced dynamic rank allocation and sparsity-based methods. Notably, the gains are particularly pronounced in challenging low-rank and low-data regimes. Crucially, since the proposed modules operate only during training, StructLoRA improves performance with zero additional inference cost, shifting the focus of PEFT from mere parameter compression to a more holistic optimization of information quality and structural integrity.
2025
Sensitivity-LoRA : Low-Load Sensitivity-Based Fine-Tuning for Large Language Models
Hao Zhang | Bo Huang | Zhenjia Li | Xi Xiao | Hui Yi Leong | Zumeng Zhang | Xinwei Long | Tianyang Wang | Hao Xu
Findings of the Association for Computational Linguistics: EMNLP 2025
Hao Zhang | Bo Huang | Zhenjia Li | Xi Xiao | Hui Yi Leong | Zumeng Zhang | Xinwei Long | Tianyang Wang | Hao Xu
Findings of the Association for Computational Linguistics: EMNLP 2025
Large Language Models (LLMs) have transformed both everyday life and scientific research. However, adapting LLMs from general-purpose models to specialized tasks remains challenging, particularly in resource-constrained environments. Low-Rank Adaptation (LoRA), a prominent method within Parameter-Efficient Fine-Tuning (PEFT), has emerged as a promising approach to LLMs by approximating model weight updates using low-rank decomposition. However, LoRA is limited by its uniform rank ( r ) allocation to each incremental matrix, and existing rank allocation techniques aimed at addressing this issue remain computationally inefficient, complex, and unstable, hindering practical applications. To address these limitations, we propose Sensitivity-LoRA, an efficient fine-tuning method that dynamically allocates ranks to weight matrices based on both their global and local sensitivities. It leverages the second-order derivatives (Hessian Matrix) of the loss function to effectively capture weight sensitivity, enabling optimal rank allocation with minimal computational overhead. Our experimental results have demonstrated robust effectiveness, efficiency and stability of Sensitivity-LoRA across diverse tasks and benchmarks.
Search
Fix author
Co-authors
- Tianyang Wang 3
- Hao Xu 3
- Bo Huang 2
- Zhenjia Li 2
- Chenrui Ma 2
- Hao Zhang 2
- Yunbei Zhang 2
- Lin Zhao 2
- Octavia Camps 1
- Yiqun Duan 1
- Yifan Gao 1
- Yifan Gong 1
- Lewei He 1
- Guosheng Hu 1
- Xinru Jiang 1
- Yang Jingsong 1
- Qizhen Lan 1
- Hui Yi Leong 1
- Haolin Li 1
- Yanshu Li 1
- Chen Liu 1
- Xinwei Long 1
- Tianyu Shi 1
- Jinwei Su 1
- Janet Wang 1
- Yanzhi Wang 1
- Zeyu Wang 1
- Zhuxuanzi Wang 1
- Hairu Wen 1
- Yuhang Wu 1
- Yinghui Xia 1
- Xiaoxincc 1
- Heng Zhang 1
- Shuyang Zhang 1
- Zumeng Zhang 1