Qi Guo
Author directoryOther people with similar names: Qi Guo, Qi Guo
Unverified author pages with similar names: Qi Guo
2026
CirCA: Aligning Credit Assignment with Circuit Semantics via Atomic Logic Blocks for RTL Generation
Lei Huang | Rui Zhang | Jiaming Guo | Yang Zhang | Di Huang | Zidong Du | Xing Hu | Qi Guo | Yunji Chen
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Lei Huang | Rui Zhang | Jiaming Guo | Yang Zhang | Di Huang | Zidong Du | Xing Hu | Qi Guo | Yunji Chen
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Reinforcement learning (RL) post-training has emerged as a promising paradigm for LLM-based Verilog generation. However, existing RL credit assignment methods are either overly coarse (sequence-level GRPO) or fragmented (line-level methods), leading to severe misattribution as they ignore the characteristics of Verilog designs that are fundamentally structured through concurrent constructs and procedural control flows. To bridge this gap, we propose CirCA, a novel RL framework that performs credit assignment based on Atomic Logic Blocks (ALBs), the smallest semantically complete units of circuit logic. CirCA decomposes Verilog into ALBs, derives reliable rewards from signal-level feedback, and then constructs logic-enhanced signal dependency cones to localize erroneous ALBs, whose localized responsibilities are further incorporated into GRPO through asymmetric advantage correction. Extensive experiments show CirCA establishes a new state-of-the-art across multiple benchmarks among non-reasoning models, and even surpasses some cutting-edge reasoning models on complex tasks.
LKV: End-to-End Learning of Head-wise Budgets and Token Selection for LLM KV Cache Eviction
Enshuai Zhou | Yifan Hao | Chao Wang | Rui Zhang | Di Huang | Jiaming Guo | Xing Hu | Zidong Du | Qi Guo | Yunji Chen
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Enshuai Zhou | Yifan Hao | Chao Wang | Rui Zhang | Di Huang | Jiaming Guo | Xing Hu | Zidong Du | Qi Guo | Yunji Chen
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Long-context inference in Large Language Models (LLMs) is bottlenecked by the linear growth of Key-Value (KV) cache memory. Existing KV cache compression paradigms are fundamentally limited by heuristics: heuristic budgeting relies on statistical priors rather than task objectives, causing resource misallocation, while heuristic selection relies on coupled query-key interactions or static inductive biases (e.g., attention sinks). To address this limitation, we introduce LKV (Learned KV Eviction), which formulates KV compression as an end-to-end differentiable optimization problem. LKV integrates LKV-H to learn task-optimized global budgets, and LKV-T to derive intrinsic KV importance without materializing attention matrices. This design bypasses heuristic proxies, strictly aligning compression with task objectives. Extensive evaluations demonstrate that LKV achieves state-of-the-art performance on both LongBench and RULER benchmarks at high compression rates. In particular, on LongBench, LKV achieves near-lossless performance with only 15% KV cache retention, and delivers up to 3.19x decoding throughput gains with negligible (~0.7%) overhead. Crucially, our analysis identifies learned budgeting as the dominant driver of fidelity, demonstrating that data-driven allocation is essential to overcome the limitations of hand-crafted heuristics.
QiMeng-PRepair: Precise Code Repair via Edit-Aware Reward Optimization
Changxin Ke | Rui Zhang | Jiaming Guo | Yuanbo Wen | Li Ding | Shuo Wang | Xuyuan Zhu | Xiong Peng | Di Huang | Zidong Du | Xing Hu | Qi Guo | Yunji Chen
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Changxin Ke | Rui Zhang | Jiaming Guo | Yuanbo Wen | Li Ding | Shuo Wang | Xuyuan Zhu | Xiong Peng | Di Huang | Zidong Du | Xing Hu | Qi Guo | Yunji Chen
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large Language Models (LLMs) achieve strong program repair performance but often suffer from over-editing, where excessive modifications overwrite correct code and hinder bug localization. We systematically quantify its impact and introduce precise repair task, which maximizes reuse of correct code while fixing only buggy parts. Building on this insight, we propose PRepair, a framework that mitigates over-editing and improves repair accuracy. PRepair has two components: Self-Breaking, which generates diverse buggy programs via controlled bug injection and min–max sampling, and Self-Repairing, which trains models with Edit-Aware Group Relative Policy Optimization (EA-GRPO) using an edit-aware reward to encourage minimal yet correct edits. Experiments show that PRepair improves repair precision by up to 31.4% under fix1@1, a metric that jointly considers repair correctness and extent, and significantly increases decoding throughput when combined with speculative editing, demonstrating its potential for precise and practical code repair.
2025
DiffZOO: A Purely Query-Based Black-Box Attack for Red-teaming Text-to-Image Generative Model via Zeroth Order Optimization
Pucheng Dang | Xing Hu | Dong Li | Rui Zhang | Qi Guo | Kaidi Xu
Findings of the Association for Computational Linguistics: NAACL 2025
Pucheng Dang | Xing Hu | Dong Li | Rui Zhang | Qi Guo | Kaidi Xu
Findings of the Association for Computational Linguistics: NAACL 2025
Current text-to-image (T2I) synthesis diffusion models raise misuse concerns, particularly in creating prohibited or not-safe-for-work (NSFW) images. To address this, various safety mechanisms and red teaming attack methods are proposed to enhance or expose the T2I model’s capability to generate unsuitable content. However, many red teaming attack methods assume knowledge of the text encoders, limiting their practical usage. In this work, we rethink the case of purely black-box attacks without prior knowledge of the T2l model. To overcome the unavailability of gradients and the inability to optimize attacks within a discrete prompt space, we propose DiffZOO which applies Zeroth Order Optimization to procure gradient approximations and harnesses both C-PRV and D-PRV to enhance attack prompts within the discrete prompt domain. We evaluated our method across multiple safety mechanisms of the T2I diffusion model and online servers. Experiments on multiple state-of-the-art safety mechanisms show that DiffZOO attains an 8.5% higher average attack success rate than previous works, hence its promise as a practical red teaming tool for T2l models.
QiMeng-Attention: SOTA Attention Operator is generated by SOTA Attention Algorithm
Qirui Zhou | Shaohui Peng | Weiqiang Xiong | Haixin Chen | Yuanbo Wen | Haochen Li | Ling Li | Qi Guo | Yongwei Zhao | Ke Gao | Ruizhi Chen | Yanjun Wu | Zhao Chen | Yunji Chen
Findings of the Association for Computational Linguistics: ACL 2025
Qirui Zhou | Shaohui Peng | Weiqiang Xiong | Haixin Chen | Yuanbo Wen | Haochen Li | Ling Li | Qi Guo | Yongwei Zhao | Ke Gao | Ruizhi Chen | Yanjun Wu | Zhao Chen | Yunji Chen
Findings of the Association for Computational Linguistics: ACL 2025
The attention operator remains a critical performance bottleneck in large language models (LLMs), particularly for long-context scenarios. While FlashAttention is the most widely used and effective GPU-aware acceleration algorithm, it must require time-consuming and hardware-specific manual implementation, limiting adaptability across GPU architectures. Existing LLMs have shown a lot of promise in code generation tasks, but struggle to generate high-performance attention code. The key challenge is it cannot comprehend the complex data flow and computation process of the attention operator and utilize low-level primitive to exploit GPU performance.To address the above challenge, we propose an LLM-friendly Thinking Language (LLM-TL) to help LLMs decouple the generation of high-level optimization logic and low-level implementation on GPU, and enhance LLMs’ understanding of attention operator.Along with a 2-stage reasoning workflow, TL-Code generation and translation, the LLMs can automatically generate FlashAttention implementation on diverse GPUs, establishing a self-optimizing paradigm for generating high-performance attention operators in attention-centric algorithms.Verified on A100, RTX8000, and T4 GPUs, the performance of our methods significantly outshines that of vanilla LLMs, achieving a speed-up of up to 35.16×.Besides, our method not only surpasses human-optimized libraries (cuDNN and official library) in most scenarios but also extends support to unsupported hardware and data types, reducing development time from months to minutes compared with human experts.
Search
Fix author
Co-authors
- Yunji Chen 4
- Xing Hu 4
- Rui Zhang 4
- Zidong Du 3
- Jiaming Guo 3
- Di Huang 3
- Yuanbo Wen 2
- Haixin Chen 1
- Ruizhi Chen 1
- Zhao Chen 1
- Pucheng Dang 1
- Li Ding 1
- KE Gao 1
- Yifan Hao 1
- Lei Huang 1
- Changxin Ke 1
- Dong Li 1
- Haochen Li 1
- Ling Li 1
- Shaohui Peng 1
- Xiong Peng 1
- Chao Wang 1
- Shuo Wang 1
- Yanjun Wu 1
- Weiqiang Xiong 1
- Kaidi Xu 1
- Yang Zhang 1
- Yongwei Zhao 1
- Enshuai Zhou 1
- Qirui Zhou 1
- Xuyuan Zhu 1