Ziqi Gao
Author directory2026
TKG-Thinker: Towards Dynamic Reasoning over Temporal Knowledge Graphs via Agentic Reinforcement Learning
Zihao Jiang | Miao Peng | Zhenyan Shan | Wenjie Xu | Ben Liu | Gong Chen | Ziqi Gao | Min Peng
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zihao Jiang | Miao Peng | Zhenyan Shan | Wenjie Xu | Ben Liu | Gong Chen | Ziqi Gao | Min Peng
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Temporal knowledge graph question answering (TKGQA) aims to answer time-sensitive questions by leveraging temporal knowledge bases. While Large Language Models (LLMs) demonstrate significant potential in TKGQA, current prompting strategies constrain their efficacy in two primary ways. First, they are prone to reasoning hallucinations under complex temporal constraints. Second, static prompting limits model autonomy and generalization, as it lacks optimization through dynamic interaction with temporal knowledge graph (TKG) environments. To address these limitations, we propose TKG-Thinker, a novel agent equipped with autonomous planning and adaptive retrieval capabilities for reasoning over TKGs. Specifically, TKG-Thinker performs in-depth temporal reasoning through dynamic multi-turn interactions with TKGs via a dual-training strategy. We first apply Supervised Fine-Tuning (SFT) with chain of thought data to instill core planning capabilities, followed by a Reinforcement Learning (RL) stage that leverages multi-dimensional rewards to refine reasoning policies under intricate temporal constraints. Experimental results on benchmark datasets with three open-source LLMs show that TKG-Thinker achieves state-of-the-art performance and exhibits strong generalization across complex TKGQA settings.
2025
Revisiting LoRA through the Lens of Parameter Redundancy: Spectral Encoding Helps
Jiashun Cheng | Aochuan Chen | Nuo Chen | Ziqi Gao | Yuhan Li | Jia Li | Fugee Tsung
Findings of the Association for Computational Linguistics: ACL 2025
Jiashun Cheng | Aochuan Chen | Nuo Chen | Ziqi Gao | Yuhan Li | Jia Li | Fugee Tsung
Findings of the Association for Computational Linguistics: ACL 2025
Low-Rank Adaptation (LoRA) has emerged as a prominent technique for fine-tuning large foundation models. Despite its successes, the substantial parameter redundancy, which limits the capacity and efficiency of LoRA, has been recognized as a bottleneck. In this work, we systematically investigate the impact of redundancy in fine-tuning LoRA and reveal that reducing density redundancy does not degrade expressiveness. Based on this insight, we introduce Spectral-encoding Low-Rank Adaptation (SeLoRA), which harnesses the robust expressiveness of spectral bases to re-parameterize LoRA from a sparse spectral subspace. Designed with simplicity, SeLoRA enables seamless integration with various LoRA variants for performance boosting, serving as a scalable plug-and-play framework. Extensive experiments substantiate that SeLoRA achieves greater efficiency with fewer parameters, delivering superior performance enhancements over strong baselines on various downstream tasks, including commonsense reasoning, math reasoning, and code generation.
Parameter-Efficient Fine-Tuning via Circular Convolution
Aochuan Chen | Jiashun Cheng | Zijing Liu | Ziqi Gao | Fugee Tsung | Yu Li | Jia Li
Findings of the Association for Computational Linguistics: ACL 2025
Aochuan Chen | Jiashun Cheng | Zijing Liu | Ziqi Gao | Fugee Tsung | Yu Li | Jia Li
Findings of the Association for Computational Linguistics: ACL 2025
Low-Rank Adaptation (LoRA) has gained popularity for fine-tuning large foundation models, leveraging low-rank matrices A and B to represent weight changes (i.e., 𝛥 W = B A). This method reduces trainable parameters and mitigates heavy memory consumption associated with full delta matrices by sequentially multiplying A and B with the activation. Despite its success, the intrinsic low-rank characteristic may limit its performance. Although several variants have been proposed to address this issue, they often overlook the crucial computational and memory efficiency brought by LoRA. In this paper, we propose Circular Convolution Adaptation (C3A), which not only achieves high-rank adaptation with enhanced performance but also excels in both computational power and memory utilization. Extensive experiments demonstrate that C3A consistently outperforms LoRA and its variants across various fine-tuning tasks.