Zhuoyao Wang
2025
RoBGuard: Enhancing LLMs to Assess Risk of Bias in Clinical Trial Documents
Changkai Ji
|
Bowen Zhao
|
Zhuoyao Wang
|
Yingwen Wang
|
Yuejie Zhang
|
Ying Cheng
|
Rui Feng
|
Xiaobo Zhang
Proceedings of the 31st International Conference on Computational Linguistics
Randomized Controlled Trials (RCTs) are rigorous clinical studies crucial for reliable decision-making, but their credibility can be compromised by bias. The Cochrane Risk of Bias tool (RoB 2) assesses this risk, yet manual assessments are time-consuming and labor-intensive. Previous approaches have employed Large Language Models (LLMs) to automate this process. However, they typically focus on manually crafted prompts and a restricted set of simple questions, limiting their accuracy and generalizability. Inspired by the human bias assessment process, we propose RoBGuard, a novel framework for enhancing LLMs to assess the risk of bias in RCTs. Specifically, RoBGuard integrates medical knowledge-enhanced question reformulation, multimodal document parsing, and multi-expert collaboration to ensure both completeness and accuracy. Additionally, to address the lack of suitable datasets, we introduce two new datasets: RoB-Item and RoB-Domain. Experimental results demonstrate RoBGuard’s effectiveness on the RoB-Item dataset, outperforming existing methods.
Search
Fix data
Co-authors
- Ying Cheng 1
- Rui Feng 1
- Changkai Ji 1
- Yingwen Wang 1
- Yuejie Zhang 1
- show all...