One Prompt Does Not Fit All: Self-Meta-Evolve for Personalized Information Extraction

Hongliang Li, Lu Wang, Yong Xu, Hanyang Chen, Zhitao Hou, Xiaoting Qin, Song Ge, Qingwei Lin, Dongmei Zhang


Abstract
Large language models (LLMs) are increasingly deployed for enterprise information extraction (IE), where the same document must be reorganized differently for each user. Existing prompt optimization methods, however, rely on a single prompt optimized against a global objective, which is misaligned with the inherent user heterogeneity of real workplaces. We formulate enterprise IE as per-user prompt adaptation under interaction feedback and propose Self-Meta-Evolve, a hierarchical framework that maintains a dedicated prompt for each user and continuously refines it through a dual-loop process: an inner loop that edits structured prompts based on persona-conditioned feedback, and an outer loop that evolves the meta-prompt itself by distilling successful editing patterns. To enable scalable training and evaluation, we release a persona-driven IE benchmark of 292 simulated enterprise users, paired with a reproducible persona-generation pipeline grounded in O*NET occupational taxonomies. On this benchmark, Self-Meta-Evolve achieves a 74.58% success rate, outperforming the strongest prompt-optimization baseline by 13.56 absolute points, and reaches 52.54% within only two iterations. A double-blind human study with twenty real professionals further confirms that prompts adapted by our framework win against static baselines in 71% of pairwise comparisons.
Anthology ID:
2026.findings-aacl.170
Volume:
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3392–3407
Language:
URL:
https://aclanthology.org/2026.findings-aacl.170/
DOI:
Bibkey:
Cite (ACL):
Hongliang Li, Lu Wang, Yong Xu, Hanyang Chen, Zhitao Hou, Xiaoting Qin, Song Ge, Qingwei Lin, and Dongmei Zhang. 2026. One Prompt Does Not Fit All: Self-Meta-Evolve for Personalized Information Extraction. In Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026, pages 3392–3407, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
One Prompt Does Not Fit All: Self-Meta-Evolve for Personalized Information Extraction (Li et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-aacl.170.pdf