Rubing Chen
Author directory2026
To Retrieve or To Think? Cross-Boundary Context Evolution for Multi-hop Complex Reasoning
Rubing Chen | Jian Wang | Wenjie Li | Xiao-Yong Wei | Li Qing
Findings of the Association for Computational Linguistics: EMNLP 2026
Rubing Chen | Jian Wang | Wenjie Li | Xiao-Yong Wei | Li Qing
Findings of the Association for Computational Linguistics: EMNLP 2026
Current context augmentation methods, such as retrieval-augmented generation, play a crucial role in bridging a model’s internal knowledge boundary and external evidence for multi-hop reasoning. However, they often follow a rigid policy and treat external retrieval as the default action at each step. Such brute-force context expansion incurs unnecessary computational cost and may degrade reasoning performance by saturating the context with redundant or weakly relevant evidence. In this paper, we propose Cross-Boundary Context Evolution (EvoCtx), a framework that models complex reasoning as an adaptive process of boundary-aware context evolution. EvoCtx dynamically decides whether the next reasoning transition should cross the current evidence boundary through retrieval or refine the reasoning state within the existing context. It estimates the semantic gap between the reasoning state and the accumulated evidence, and strategically alternates between boundary expansion and intra-boundary trajectory refinement. This eliminates redundant retrieval steps and preserves a compact, evidence-supported reasoning trajectory. Extensive experiments on challenging open-domain and multi-hop QA benchmarks demonstrate that EvoCtx significantly outperforms previous methods, offering an effective approach to complex tasks. The source code can be accessed at https://github.com/Anya-RB-Chen/EvoCtx.
2025
Benchmarking for Domain-Specific LLMs: A Case Study on Academia and Beyond
Rubing Chen | Jiaxin Wu | Jian Wang | Xulu Zhang | Wenqi Fan | Chenghua Lin | Xiao-Yong Wei | Li Qing
Findings of the Association for Computational Linguistics: EMNLP 2025
Rubing Chen | Jiaxin Wu | Jian Wang | Xulu Zhang | Wenqi Fan | Chenghua Lin | Xiao-Yong Wei | Li Qing
Findings of the Association for Computational Linguistics: EMNLP 2025
The increasing demand for domain-specific evaluation of large language models (LLMs) has led to the development of numerous benchmarks. These efforts often adhere to the principle of data scaling, relying on large corpora or extensive question-answer (QA) sets to ensure broad coverage. However, the impact of corpus and QA set design on the precision and recall of domain-specific LLM performance remains poorly understood. In this paper, we argue that data scaling is not always the optimal principle for domain-specific benchmark construction. Instead, we introduce Comp-Comp, an iterative benchmarking framework grounded in the principle of comprehensiveness and compactness. Comprehensiveness ensures semantic recall by covering the full breadth of the domain, while compactness improves precision by reducing redundancy and noise. To demonstrate the effectiveness of our approach, we present a case study conducted at a well-renowned university, resulting in the creation of PolyBench, a large-scale, high-quality academic benchmark. Although this study focuses on academia, the Comp-Comp framework is domain-agnostic and readily adaptable to a wide range of specialized fields. The source code and datasets can be accessed at https://github.com/Anya-RB-Chen/COMP-COMP.