Guided Profile Generation Improves Personalization with Large Language Models

Jiarui Zhang


Abstract
In modern commercial systems, including Recommendation, Ranking, and E-Commerce platforms, there is a trend towards improving customer experiences by incorporating Personalization context as input into Large Language Models (LLM). However, LLMs often struggle to effectively parse and utilize sparse and complex personal context without additional processing or contextual enrichment, underscoring the need for more sophisticated context understanding mechanisms. In this work, we propose Guided Profile Generation (GPG), a general method designed to generate personal profiles in natural language. As is observed, intermediate guided profile generation enables LLMs to summarize, and extract the important, distinctive features from the personal context into concise, descriptive sentences, precisely tailoring their generation more closely to an individual’s unique habits and preferences. Our experimental results show that GPG improves LLM’s personalization ability across different tasks, for example, it increases 37% accuracy in predicting personal preference compared to directly feeding the LLMs with raw personal context.
Anthology ID:
2024.findings-emnlp.231
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2024
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4005–4016
Language:
URL:
https://aclanthology.org/2024.findings-emnlp.231
DOI:
Bibkey:
Cite (ACL):
Jiarui Zhang. 2024. Guided Profile Generation Improves Personalization with Large Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 4005–4016, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
Guided Profile Generation Improves Personalization with Large Language Models (Zhang, Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-emnlp.231.pdf