Boyan Shi
Author directory2026
SAMoRA: Semantic-Aware Mixture of LoRA Experts for Task-Adaptive Learning
Boyan Shi | Wei Chen | Shuyuan Zhao | Junfeng Shen | Shengnan Guo | Shaojiang Wang | Huaiyu Wan
Findings of the Association for Computational Linguistics: ACL 2026
Boyan Shi | Wei Chen | Shuyuan Zhao | Junfeng Shen | Shengnan Guo | Shaojiang Wang | Huaiyu Wan
Findings of the Association for Computational Linguistics: ACL 2026
The combination of Mixture-of-Experts (MoE) and Low-Rank Adaptation (LoRA) has shown significant potential for enhancing the multi-task learning capabilities of Large Language Models. However, existing methods face two primary challenges: (1)Imprecise Routing in the current MoE-LoRA method fails to explicitly match input semantics with expert capabilities, leading to weak expert specialization. (2)Uniform weight fusion strategies struggle to provide adaptive update strengths, overlooking the varying complexity of different tasks. To address these limitations, we propose SAMoRA (Semantic-Aware Mixture of LoRA Experts), a novel parameter-efficient fine-tuning framework tailored for task-adaptive learning. Specifically, A Semantic-Aware Router is proposed to explicitly align textual semantics with the most suitable experts for precise routing. A Task-Adaptive Scaling mechanism is designed to regulate expert contributions based on specific task requirements dynamically. In addition, a novel regularization objective is proposed to jointly promote expert specialization and effective scaling. Extensive experiments on multiple multi-task benchmarks demonstrate that SAMoRA significantly outperforms the state-of-the-art methods and holds excellent task generalization capabilities. Code is available at https://github.com/boyan-code/SAMoRA
HG-Bench: A Benchmark for Multi-Page Handwritten Answer-Region Grounding in Automated Homework Assessment
Chuangxin Zhao | Boyan Shi | Yanling Wang | Yijian LU | Canran Xiao | Jiali Chen | Jun Xia | Yan Wang | Ji Qi | Juanzi Li
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Chuangxin Zhao | Boyan Shi | Yanling Wang | Yijian LU | Canran Xiao | Jiali Chen | Jun Xia | Yan Wang | Ji Qi | Juanzi Li
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Automated homework assessment requires not only recognizing student answers but accurately locating complete answers and intermediate reasoning steps in noisy, multi-page handwritten work. We address the missing evaluation setting of *page-aware, two-level answer-region grounding*: given homework page images, a model must localize complete answer regions and their ordered step-level subregions. We introduce **HG-Bench**, comprising 500 human-annotated K–12 homework samples curated from a 1,489,278-image source pool, with hierarchically linked question- and step-level boxes. Its page-aware protocol separately measures complete-answer localization (ℱA) and step-level decomposition (ℱS𝜇), distinguishing structured spatial grounding from visible-text parsing. Across frontier closed-source and open-weight VLMs, no zero-shot system exceeds 55.22% on ℱA or 48.22% on ℱS𝜇, whereas a GLM-4.6V 9B reference fine-tuned on approximately 10k in-domain examples reaches 74.97/72.26. These results expose step-level handwritten grounding as a concrete capability gap and provide a reproducible benchmark, evaluation protocol, and trained reference for future work on automated homework assessment.
STK-Adapter: Incorporating Evolving Graph and Event Chain for Temporal Knowledge Graph Extrapolation
Shuyuan Zhao | Wei Chen | Weijie Zhang | Xinrui Hou | Junfeng Shen | Boyan Shi | Shengnan Guo | Youfang Lin | Huaiyu Wan
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Shuyuan Zhao | Wei Chen | Weijie Zhang | Xinrui Hou | Junfeng Shen | Boyan Shi | Shengnan Guo | Youfang Lin | Huaiyu Wan
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Temporal Knowledge Graph (TKG) extrapolation aims to predict future events based on historical facts. Recent studies have attempted to enhance TKG extrapolation by integrating TKG’s evolving structural representations and textual event chains into Large Language Models (LLMs). Yet, two main challenges limit these approaches: (1) The loss of essential spatial-temporal information due to shallow alignment between TKG’s graph evolving structural representation and the LLM’s semantic space, and (2) the progressive dilution of the TKG’s evolving structural features during LLM fine-tuning. To address these challenges, we propose the Spatial-Temporal Knowledge Adapter (STK-Adapter), which flexibly integrates the evolving graph encoder and the LLM to facilitate TKG reasoning. In STK-Adapter, a Spatial-Temporal MoE is designed to capture spatial structures and temporal patterns inherent in TKGs. An Event-Aware MoE is employed to model intricate temporal semantics dependencies within event chains. In addition, a Cross-Modality Alignment MoE is proposed to facilitate deep cross-modality alignment by TKG-guided attention experts. Extensive experiments on benchmark datasets demonstrate that STK-Adapter significantly outperforms state-of-the-art methods and exhibits strong generalization capabilities in cross-dataset task. The code is available at https://github.com/Zhaoshuyuan0246/STK-Adapter.