TrustRAG: Metadata-Governed RAG for Compliance-Oriented Question Answering

Huiling Ge, Zhiguo Shi, Yungui Nie


Abstract
Retrieval-Augmented Generation (RAG) enhances large language models with external evidence, but in compliance-oriented QA, semantic relevance alone does not determine whether evidence should be used for generation. A retrieved document may be relevant and factually correct, yet inadmissible because it is inaccessible to the current user, explicitly superseded, or in unresolved conflict with other active evidence. We formalize three post-retrieval governance failures in this setting: unauthorized leakage, stale citation, and unsupported answers. To address them, we propose TrustRAG, a RAG framework that incorporates a metadata-governed routing layer between the retriever and the generator. Given correct and complete governance metadata for the retrieved candidate set, this layer filters inadmissible evidence before generation, returns a deterministic refusal when no admissible evidence remains, and preserves unresolved conflicts for conflict-reporting generation. We construct AeroTrustBench, a counterfactual compliance QA benchmark for evaluating evidence governance in RAG. Across Qwen-Max, DeepSeek-V3, and GLM-4-32B-0414, TrustRAG consistently reduces the three failures relative to unguided RAG and baselines based on prompting, filtering, routing, verification, and recency. Mechanism-matched and 50-document comparisons show benefits beyond filtering under larger candidate pools, while metadata-noise tests and human audits characterize dependencies on upstream metadata and evaluator choice.
Anthology ID:
2026.emnlp-main.1533
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
35002–35020
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1533/
DOI:
Bibkey:
Cite (ACL):
Huiling Ge, Zhiguo Shi, and Yungui Nie. 2026. TrustRAG: Metadata-Governed RAG for Compliance-Oriented Question Answering. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 35002–35020, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
TrustRAG: Metadata-Governed RAG for Compliance-Oriented Question Answering (Ge et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1533.pdf