Caifeng Shan

Author directory

2026

Diffusion language models (dLLMs) have recently emerged as a promising alternative to autoregressive (AR) language models, offering competitive performance with a fundamentally different generation paradigm. Instead of producing tokens strictly left-to-right, dLLMs iteratively refine partially masked sequences, enabling bidirectional context modeling and supporting parallel token updates. This design creates new opportunities for accelerating generation and improving controllability. However, practical deployment of dLLMs remains challenging due to the high cost of training at scale and the lack of mature inference optimizations such as cache-friendly decoding and robust parallel sampling. In this work, we provide a comprehensive overview of recent progress on efficient dLLMs. To reflect how efficiency bottlenecks arise across the full lifecycle of dLLMs, spanning training, decoding, and deployment, we organize existing approaches into five categories: Training, Inference, Context, Framework, and Multimodality. For each category, we summarize representative methods and highlight their motivations, key techniques, and empirical trade-offs. Finally, we discuss open challenges and outline promising directions for future research toward high-throughput, robust, and practically deployable diffusion language models.
Hallucination detection in clinical large vision-language models requires cross-verifying heterogeneous evidence, including patient text and images for faithfulness, and medical knowledge for factuality. However, existing pipelines either verify these dimensions in isolation or conflate them into a uniform process, potentially causing evidence misalignment that limits detection precision. Consequently, we posit that the essence of black-box hallucination detection is an evidence routing problem and propose MedF2Route, an Evidence-Routed Graph Verification Framework for both Faithfulness and Factuality hallucination detection. Specifically, it first transforms free-text clinical queries and model responses into structured graphs, partitioning the response graph into independent subgraphs to separate patient-specific grounding from knowledge-based diagnostic inference. An evidence-aware routing and verification mechanism then dynamically dispatches response triplets in these subgraphs to their dedicated heterogeneous evidence sources for targeted verification. Experiments on our MedF2Bench diagnostic benchmark show that our framework outperforms state-of-the-art baselines, notably improving detection precision. Overall, MedF2Route enables professional and precise detection of clinical hallucinations, underpinning the trustworthiness of clinical LVLMs. The code and data are available at https://github.com/Agentic-CliniAI/MedF2Route.