Adaptive Cost-Efficient Evaluation for Reliable Patent Claim Generation

Yongmin Yoo, Qiongkai Xu, Longbing Cao


Abstract
Automated patent claim validation demands low error tolerance. However, existing approaches face a rigidity-resource dilemma: lightweight encoders cannot track long-range legal dependencies, while exhaustive LLM verification incurs 4-5X higher overhead at million-claim scale. A naive confidence-based cascade cannot resolve this because binary validity scores fail to distinguish structurally distinct error types which require different reasoning depths. We propose a two-stage framework: Adaptive Cost-efficient Evaluation (ACE), which exploits the categorical structure of patent errors for uncertainty-aware routing. In the first stage, a fine-tuned encoder projects claims into a K+1 distribution over legal error types, whose predictive entropy serves as the routing signal. Claims exceeding an entropy threshold are escalated to the second stage, where an expert LLM executes a schema-constrained Chain-of-Patent-Thought (CoPT) protocol to map claim elements against 35 U.S.C. standards whose schema constraint reduces per-claim latency by 42% while producing legally grounded verdicts. We further present a 40,000-claim dataset ACE-40k with MPEP-grounded annotations, where ACE surpasses competitive baselines including a supervised 70B-parameter LLM while reducing costs by 78%. On real USPTO rejection data, the routing mechanism transfers without re-calibration, reducing inference time by 60% while maintaining competitive recall.
Anthology ID:
2026.findings-emnlp.1386
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
29501–29518
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1386/
DOI:
Bibkey:
Cite (ACL):
Yongmin Yoo, Qiongkai Xu, and Longbing Cao. 2026. Adaptive Cost-Efficient Evaluation for Reliable Patent Claim Generation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 29501–29518, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Adaptive Cost-Efficient Evaluation for Reliable Patent Claim Generation (Yoo et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1386.pdf