PrefTool: Lightweight Preference-Aware Retrieval for Personalized Tool Selection

Xuanzhen Li, Linan Yue


Abstract
Personalized tool selection for LLM-based agents aims to identify tools that align with both user intent and individual preferences, particularly in redundant API ecosystems where multiple tools offer similar functionality but differ in non-functional attributes. Existing generative approaches typically depend on fine-tuning large language models to infer user preferences, leading to substantial computational overhead and deployment costs. Despite these expensive training requirements, they still struggle to reliably distinguish functionally equivalent tools and often fail to capture users’ implicit non-functional preferences. To this end, we propose PrefTool, a lightweight yet effective preference-aware retrieval framework for personalized tool selection. PrefTool avoids costly generative preference modeling by employing a dual-encoder retrieval architecture that maps user context and tools into a shared representation space. Through structured tool representations, type-aware history modeling, and hard negative sampling, it efficiently captures users’ non-functional preferences while maintaining strong selection accuracy. Experiments on a personalized tool selection benchmark demonstrate the effectiveness of PrefTool.
Anthology ID:
2026.findings-emnlp.785
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
16610–16623
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.785/
DOI:
10.18653/2026.findings-emnlp.785
Bibkey:
Cite (ACL):
Xuanzhen Li and Linan Yue. 2026. PrefTool: Lightweight Preference-Aware Retrieval for Personalized Tool Selection. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 16610–16623, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
PrefTool: Lightweight Preference-Aware Retrieval for Personalized Tool Selection (Li & Yue, Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.785.pdf