Improving the plot progression ability of role-playing language agents (RPLAs) plays a critical role in enhancing user experience and dialogue immersion. However, research on plot progression in role-playing language agents is still limited. Existing datasets often contain too few dialogue turns and lack large-scale sentences with clear deterministic plot turns, which restricts further model development and evaluation. To bridge this gap, we propose RoleArena, an innovative multi-agent role-playing environment. By introducing a critic agent and combining discrete plot lines with environment-agent-based dynamic judgments, the system generates long multi-turn dialogues with key markers for plot progression. Based on RoleArena, we construct the PlotStream dataset, which contains 39.3k characters and 170k dialogues, with annotations for key plot progression sentences. In addition, based on PlotStream, we further develop PlotRole-7B and PlotRole-72B, RPLAs built upon the Qwen2.5 model and specialized in plot progression capabilities. Extensive experiments show that RoleArena and PlotRole improve dialogue generation with plot progression and strengthen the ability of plot progression.

Pre-trained language models (PLMs) are widely used in NLP but struggle with capturing entity knowledge. To address this, knowledge enhancement techniques have been proposed. However, existing methods rely heavily on external knowledge bases embedding and often introduce noisy entity representations. In this work, we propose a novel Knowledge Enhancement Filtering Framework named KEFF, which contains both knowledge enhancement and knowledge enhancement filtering modules for PLM. We find that there are certain redundant bits in the embedding space of PLMs. Building on this insight, we implement knowledge-enhanced mapping of redundant bit values in entity span tokens. In order to solve the knowledge enhancement problem of existing methods that introduce noisy entity representation knowledge, we further propose a novel knowledge enhancement filter based on our knowledge enhancement method. Finally, experiments on four knowledge-driven NLP tasks show that our method effectively improves the ability of PLMs on downstream tasks. Compared to state-of-the-art approachs, our method achieves the highest F1-score and accuracy, while reducing the computational cost by 1.7-2.5x.

Knowledge graph question answering (KGQA) aims to answer natural language questions using knowledge graphs.Recent research leverages large language models (LLMs) to enhance KGQA reasoning, but faces limitations: retrieval-based methods are constrained by the quality of retrieved information, while agent-based methods rely heavily on proprietary LLMs.To address these limitations, we propose Retrieval-Judgment-Exploration (RJE), a framework that retrieves refined reasoning paths, evaluates their sufficiency, and conditionally explores additional evidence. Moreover, RJE introduces specialized auxiliary modules enabling small-sized LLMs to perform effectively: Reasoning Path Ranking, Question Decomposition, and Retriever-assisted Exploration. Experiments show that our approach with proprietary LLMs (such as GPT-4o-mini) outperforms existing baselines while enabling small open-source LLMs (such as 3B and 8B parameters) to achieve competitive results without fine-tuning LLMs.Additionally, RJE substantially reduces the number of LLM calls and token usage compared to agent-based methods, yielding significant efficiency improvements.