Longchao Da
Author directory2026
Uncertainty Quantification of Large Language Models through Multiple Uncertainty Sources
Tiejin Chen | Xiaoou Liu | Longchao Da | Jia Chen | Evangelos E. Papalexakis | Hua Wei
Findings of the Association for Computational Linguistics: ACL 2026
Tiejin Chen | Xiaoou Liu | Longchao Da | Jia Chen | Evangelos E. Papalexakis | Hua Wei
Findings of the Association for Computational Linguistics: ACL 2026
Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse domains. However, the reliability of responses from LLMs remains a question. Uncertainty quantification (UQ) of LLMs is crucial for ensuring their reliability, especially in areas such as healthcare. Existing UQ methods, often designed around a single resource such as Natural Language Inference (NLI) or graph-based metrics, fail to capture the multifaceted nature of uncertainty in natural language generation. In this work, we propose MS-UQ, a novel Multi-Resource Uncertainty Quantification framework that integrates heterogeneous uncertainty signals into a unified measure. Our approach concatenates matrices from diverse resources and employs tensor decomposition to orthogonally disentangle unique and shared information. To ensure scalability, we construct an adaptive ensemble of outputs from different decomposition methods, enabling the incorporation of new uncertainty sources. Experiments on CoQA, NQ_Open, and HotpotQA demonstrate that MS-UQ consistently outperforms existing methods, offering a comprehensive and scalable solution for uncertainty estimation in black-box LLMs and a more robust framework for enhancing LLM reliability in high-stakes applications. Our code can be accessed at https://anonymous.4open.science/r/MDUQ-First-202E/README.md.
LangMARL: Natural Language Multi-Agent Reinforcement Learning via Semantic Credit Assignment
Huaiyuan Yao | Longchao Da | Xiaoou Liu | Charles Fleming | Tianlong Chen | Hua Wei
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Huaiyuan Yao | Longchao Da | Xiaoou Liu | Charles Fleming | Tianlong Chen | Hua Wei
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large language model (LLM) agents struggle to autonomously evolve coordination strategies in dynamic environments, largely because coarse global outcomes obscure the causal signals needed for local policy refinement. We identify this bottleneck as a multi-agent credit assignment problem, which has long been studied in classical multi-agent reinforcement learning (MARL) but remains underaddressed in LLM-based systems. Building on this observation, we propose LangMARL, a framework that brings credit assignment and policy gradient evolution from cooperative MARL into the language space. LangMARL introduces agent-level language credit assignment, pioneers gradient evolution in language space for policy improvement, and summarizes task-relevant causal relations from replayed trajectories to provide dense feedback and improve convergence under sparse rewards. Extensive experiments across diverse cooperative multi-agent tasks demonstrate improved sample efficiency, interpretability, and strong generalization.