Measuring the Impact of LLM-Generated Scientific Summaries for Neurodivergent Readers

Abraham Ur Rahman, Skyler Koba, Audrey Michal, Steven R Wilson


Abstract
Language technologies increasingly mediate access to scientific information, yet their impact depends on whether they improve real reading experiences for diverse audiences. We study large language model (LLM)-generated scientific summaries as an accessibility intervention for neurodivergent adults, focusing on readers with ADHD and/or autism. Using a mixed-methods design, we first conducted a formative qualitative study with 10 neurodivergent adults to identify design needs. We then ran a quantitative experiment with 200 neurodivergent adults comparing five summary styles across lower- and higher-complexity scientific texts, measuring comprehension, trust, engagement, and cognitive load. Results show that writing-style effects depend on text complexity: structured LLM-generated summaries improved comprehension for higher-complexity articles but reduced comprehension for lower-complexity articles relative to a baseline human-generated extractive summary. Trust increased for simpler LLM summary styles, while engagement and cognitive load showed fewer robust writing-style effects. Our findings suggest that accessible NLP systems should adapt explanatory support to reader needs and text difficulty, rather than offering a single “best” summary style.
Anthology ID:
2026.nlp4pi-1.26
Volume:
Proceedings of the Fifth Workshop on NLP for Positive Impact (NLP4PI)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Katherine Atwell, Angana Borah, Daryna Dementieva, Elisa Kreiss, Neema Kotonya, Jiarui Liu, Liz Olson, Ruyuan Wan, Jieyu Zhao
Venues:
NLP4PI | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
298–311
Language:
URL:
https://aclanthology.org/2026.nlp4pi-1.26/
DOI:
Bibkey:
Cite (ACL):
Abraham Ur Rahman, Skyler Koba, Audrey Michal, and Steven R Wilson. 2026. Measuring the Impact of LLM-Generated Scientific Summaries for Neurodivergent Readers. In Proceedings of the Fifth Workshop on NLP for Positive Impact (NLP4PI), pages 298–311, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Measuring the Impact of LLM-Generated Scientific Summaries for Neurodivergent Readers (Rahman et al., NLP4PI 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.nlp4pi-1.26.pdf