Query Routing for Homogeneous Tools: An Instantiation in the RAG Scenario

Feiteng Mu, Yong Jiang, Liwen Zhang, Liuchu Liuchu, Wenjie Li, Pengjun Xie, Fei Huang


Abstract
Current research on tool learning primarily focuses on selecting the most effective tool from a wide array of options, often overlooking cost-effectiveness, a crucial factor in human problem-solving. In this paper, we address query routing for homogeneous tools by predicting both their performance and the associated cost required to accomplish a given task. We then assign queries to the optimal tools in a cost-effective manner. Our experimental results demonstrate that our method achieves higher performance at a lower cost compared to strong baseline approaches.
Anthology ID:
2024.findings-emnlp.598
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2024
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
10225–10230
Language:
URL:
https://aclanthology.org/2024.findings-emnlp.598
DOI:
Bibkey:
Cite (ACL):
Feiteng Mu, Yong Jiang, Liwen Zhang, Liuchu Liuchu, Wenjie Li, Pengjun Xie, and Fei Huang. 2024. Query Routing for Homogeneous Tools: An Instantiation in the RAG Scenario. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 10225–10230, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
Query Routing for Homogeneous Tools: An Instantiation in the RAG Scenario (Mu et al., Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-emnlp.598.pdf