Streamlining Conformal Information Retrieval via Score Refinement

Yotam Intrator, Regev Cohen, Ori Kelner, Roman Goldenberg, Ehud Rivlin, Daniel Freedman


Abstract
Information retrieval (IR) methods, like retrieval augmented generation, are fundamental to modern applications but often lack statistical guarantees. Conformal prediction addresses this by retrieving sets guaranteed to include relevant information, yet existing approaches produce large-sized sets, incurring high computational costs and slow response times. In this work, we introduce a score refinement method that applies a simple monotone transformation to retrieval scores, leading to significantly smaller conformal sets while maintaining their statistical guarantees. Experiments on various BEIR benchmarks validate the effectiveness of our approach in producing compact sets containing relevant information.
Anthology ID:
2024.fever-1.22
Volume:
Proceedings of the Seventh Fact Extraction and VERification Workshop (FEVER)
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Michael Schlichtkrull, Yulong Chen, Chenxi Whitehouse, Zhenyun Deng, Mubashara Akhtar, Rami Aly, Zhijiang Guo, Christos Christodoulopoulos, Oana Cocarascu, Arpit Mittal, James Thorne, Andreas Vlachos
Venue:
FEVER
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
186–191
Language:
URL:
https://aclanthology.org/2024.fever-1.22
DOI:
Bibkey:
Cite (ACL):
Yotam Intrator, Regev Cohen, Ori Kelner, Roman Goldenberg, Ehud Rivlin, and Daniel Freedman. 2024. Streamlining Conformal Information Retrieval via Score Refinement. In Proceedings of the Seventh Fact Extraction and VERification Workshop (FEVER), pages 186–191, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
Streamlining Conformal Information Retrieval via Score Refinement (Intrator et al., FEVER 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.fever-1.22.pdf