Ming Chen
Author directoryOther people with similar names: Ming Chen, Ming Chen, Ming Chen
Unverified author pages with similar names: Ming Chen
2026
PREREVIEWBENCH: Benchmarking LLMs for Editorial Desk Screening in Scholarly Publishing
Ming Chen | Zhiyuan Ning | Yi Du
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Ming Chen | Zhiyuan Ning | Yi Du
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Before any reviewer is assigned, a journal editor decides whether a manuscript merits external review. Yet this routine desk screening has no benchmark. We present PREREVIEWBENCH, the first controlled benchmark for journal desk screening. Because real desk decisions are confidential, we pair Web of Science papers published in 2025 with journals to construct proxy labels: true matches, within-field caliber surpluses and deficits, and cross-field scope mismatches. The 7,292 balanced paper–journal instances span four broad areas and 58 journals, supporting desk triage, branch-specific assessment (caliber fit or rejection cause), and transfer-journal recommendation. Evaluating four frontier LLM families, we find average triage accuracy of 0.965 on cross-field scope mismatches but only 0.572 on within-field caliber deficits, where blind expert-led review reproduces the triage labels perfectly. Transfer recommendation is weaker still, with the best Hit@1 at just 0.369. Models are also sensitive to input perturbations, and a cue suggesting that most papers merit review sharply shifts GPT-5.5’s decisions. These results point to a clear division of labor: LLMs can already carry the scope side of desk screening, while caliber judgment stays with editors. PREREVIEWBENCH makes that harder half measurable: whether an in-scope paper is strong enough for its journal.