FrankenReport: Early Exiting in Long-Form Generation Using Expected Value of Computation

Zhengping Jiang, Gonzalo Ramos, Jina Suh, Shiqian Rachel NG, Elias Stengel-Eskin, Justin Svegliato, Benjamin Van Durme, Andy Huntington, Sam Thomson


Abstract
While deep research systems address interactive information-seeking needs impressively, their real-world deployments face latency and resource-consumption challenges. We present FrankenReport, an interface for long-form knowledge-seeking report generation that supports adaptive early exiting per section: it evaluates intermediate outputs during generation and predicts whether further targeted computation will yield significant quality gains. In a simulation study, FrankenReport outperforms random allocation baselines by a large margin (up to 4×) under low budgets and smoothly recovers full-pipeline quality as the budget grows, showing that future quality gains are predictable from intermediate drafts. Through experiments and user studies, we further show that despite varying preferences across users and topics, FrankenReport adapts to simple, natural user feedback as efficiently as methods requiring much costlier supervision such as generated drafts and explicit rationales.
Anthology ID:
2026.emnlp-main.2548
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
57929–57951
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2548/
DOI:
Bibkey:
Cite (ACL):
Zhengping Jiang, Gonzalo Ramos, Jina Suh, Shiqian Rachel NG, Elias Stengel-Eskin, Justin Svegliato, Benjamin Van Durme, Andy Huntington, and Sam Thomson. 2026. FrankenReport: Early Exiting in Long-Form Generation Using Expected Value of Computation. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 57929–57951, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
FrankenReport: Early Exiting in Long-Form Generation Using Expected Value of Computation (Jiang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2548.pdf