WARP: Wasserstein-Aligned RAG for Population Opinions

Aman Singh Thakur, Aditya Agrawal, Alwarappan Nakkiran, Alex Karlsson


Abstract
RAG systems are increasingly used to summarize what large collections of documents say. A user asks "What do people think about X?" and receives an answer that reads as consensus. But standard top-k retrieval ranks documents by query similarity, not by how faithfully they represent the population, so minority views quietly disappear. Existing fixes fall short. Diversity re-rankers like MMR and DPP spread retrieved documents apart, but with no target distribution to aim for. Calibration methods based on KL or JS divergence do target one, yet treat opinion bins as unordered: confusing strong positive with strong negative costs no more than an adjacent-bin miss.

We introduce WARP, a family of post-retrieval algorithms that calibrate retrieved evidence to the population’s opinion distribution. WARP first recovers underrepresented opinions that cosine ranking may bury, then uses Wasserstein-1 distance to select documents whose sentiment-intensity distribution matches the population target, capturing the ordinal structure ignored by KL and JS divergence. We develop three variants for dense, sparse, and variable candidate pools, trading off calibration quality and speed. Across three review domains spanning 35K documents, 156 queries, and 26 entities, WARP’s domain-matched variants reduce distributional error by at least 43% with sub-second latency. These gains carry through to generation: a five-judge LLM panel prefers WARP-generated answers in up to 86% of decided comparisons at k=5.
Anthology ID:
2026.emnlp-industry.158
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pepa Atanasova, Gholamreza Haffari, Minghan Wang
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2684–2704
Language:
URL:
https://aclanthology.org/2026.emnlp-industry.158/
DOI:
Bibkey:
Cite (ACL):
Aman Singh Thakur, Aditya Agrawal, Alwarappan Nakkiran, and Alex Karlsson. 2026. WARP: Wasserstein-Aligned RAG for Population Opinions. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 2684–2704, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
WARP: Wasserstein-Aligned RAG for Population Opinions (Thakur et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-industry.158.pdf