Linyi Ding
Author directory2026
APeB: Benchmarking Personalization Ability of Large Language Model Agents
Garry Yang | Zizhe Chen | Xinru Chen | Yongqiang Chen | Jianxiang Wang | Deyu Zou | Linyi Ding | Jialiang Wu | Yunzhong He | Yu Gong | James Cheng | Huaixiao Tou
Findings of the Association for Computational Linguistics: EMNLP 2026
Garry Yang | Zizhe Chen | Xinru Chen | Yongqiang Chen | Jianxiang Wang | Deyu Zou | Linyi Ding | Jialiang Wu | Yunzhong He | Yu Gong | James Cheng | Huaixiao Tou
Findings of the Association for Computational Linguistics: EMNLP 2026
LLM-powered agents struggle with personalization when users issue raw, underspecified queries. In this setting, agents must infer latent intent, extract preferences from noisy interaction histories, and select among competing alternatives. Existing benchmarks rarely test this capability, as they often rely on user-refined queries or simplified histories. We introduce personalized product search (PPS), a testbed for agentic personalization under raw queries and diverse histories. We construct **A**gent **Pe**rsonalized **B**enchmark (**APeB**) from action logs, pairing underspecified intents with rich histories and user-viewed candidate items. Evaluating state-of-the-art LLMs with multi-step agent workflows, we find that models handle explicit queries well but struggle with early-stage queries requiring intent and preference discovery. Rubric analysis attributes this gap mainly to ineffective history use. A simple history-aware query-refinement pipeline, VQRA, yields consistent gains, highlighting the need for dedicated history-utilization modules in personalized agents.
2024
Topic-Oriented Open Relation Extraction with A Priori Seed Generation
Linyi Ding | Jinfeng Xiao | Sizhe Zhou | Chaoqi Yang | Jiawei Han
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Linyi Ding | Jinfeng Xiao | Sizhe Zhou | Chaoqi Yang | Jiawei Han
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
The field of open relation extraction (ORE) has recently observed significant advancement thanks to the growing capability of large language models (LLMs). Nevertheless, challenges persist when ORE is performed on specific topics. Existing methods give sub-optimal results in five dimensions: factualness, topic relevance, informativeness, coverage, and uniformity. To improve topic-oriented ORE, we propose a zero-shot approach called PriORE: Open Relation Extraction with a Priori seed generation. PriORE leverages the built-in knowledge of LLMs to maintain a dynamic seed relation dictionary for the topic. The dictionary is initialized by seed relations generated from topic-relevant entity types and expanded during contextualized ORE. PriORE then reduces the randomness in generative ORE by converting it to a more robust relation classification task. Experiments show the approach empowers better topic-oriented control over the generated relations and thus improves ORE performance along the five dimensions, especially on specialized and narrow topics.