Beyond One-Size-Fits-All: Multi-Agent Refinement Framework for Persona-Based Biomedical Summarization

Rohan Charudatt Salvi, Chirag Chawla, Md. Shad Akhtar, Shweta Yadav


Abstract
Lay summarization aims to make biomedical research accessible to non-experts, but most approaches assume a uniform audience, overlooking variation in medical literacy and information needs. We present MAPS (Multi-Agent Persona-based Summarization), a framework that generates persona-specific summaries through iterative cross-agent feedback. Human evaluation shows MAPS improves quality over single-agent baselines, while automatic metrics fail to capture these gains. LLM-based judges also exhibit limited sensitivity, assigning inflated scores and misdetecting errors. These findings highlight the need for improved evaluation methods for persona-based summarization.
Anthology ID:
2026.cl4health-1.28
Volume:
Proceedings of the Third Workshop on Patient-Oriented Language Processing (CL4Health) @ LREC 2026
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Deepak Gupta, Paul Thompson, Sophia Ananiadou, Dina Demner-Fushman
Venues:
CL4Health | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
320–332
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-cl4health-28
DOI:
10.63317/22uei8f8k9za
Bibkey:
Cite (ACL):
Rohan Charudatt Salvi, Chirag Chawla, Md. Shad Akhtar, and Shweta Yadav. 2026. Beyond One-Size-Fits-All: Multi-Agent Refinement Framework for Persona-Based Biomedical Summarization. In Proceedings of the Third Workshop on Patient-Oriented Language Processing (CL4Health) @ LREC 2026, pages 320–332, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
Beyond One-Size-Fits-All: Multi-Agent Refinement Framework for Persona-Based Biomedical Summarization (Salvi et al., CL4Health 2026)
Copy Citation: