Clarify User Expertise: Towards Proactive Conversational Agents Tailoring Responses to User Proficiency

Zhihong Cao, Chen Huang


Abstract
In the context of information seeking, conversational agents are undergoing an evolution from reactive tools to proactive, personalized assistants. A critical aspect of this evolution is the ability to tailor strategic interactions to a user’s unique needs and expectations. Unlike existing studies that focus on proactively clarifying query ambiguities, we center on clarifying the user’s expertise in order to tailor responses for better user comprehension. We find that existing agents struggle to determine user expertise from queries alone, a limitation that prevents them from dynamically adapting their responses. To address this gap, we introduce PASSING to empower the agent to proactively clarify a user’s expertise through targeted inquiries. This is achieved by our What-to-ask and How-to-ask strategies, induced by LLM self-play. Our extensive experiments also show our superiority. We believe that PASSING represents a crucial step towards creating more human-centric conversational agents.
Anthology ID:
2026.findings-emnlp.833
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
17653–17674
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.833/
DOI:
Bibkey:
Cite (ACL):
Zhihong Cao and Chen Huang. 2026. Clarify User Expertise: Towards Proactive Conversational Agents Tailoring Responses to User Proficiency. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 17653–17674, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Clarify User Expertise: Towards Proactive Conversational Agents Tailoring Responses to User Proficiency (Cao & Huang, Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.833.pdf