When to Defer: Scope-Aware Cascades for Structured Attribute Generation in E-commerce Product Catalogs

Fatemeh Mansoori, Andrea Scarinci, Aditya Aggarwal, Ashwin Chandramouli, Suleiman A. Khan


Abstract
Fine-tuned small language models (SLMs) are attractive defaults for large-scale structured at- tribute generation—producing values such as materials, colors, or dimensions from product descriptions—as they are inexpensive to serve. However, a fine-tuned SLM is not reliable ev- erywhere as its correctness varies sharply, so deploying it still requires deciding, per output, whether to keep the SLM’s value or escalate it to a more capable fallback. The standard pol- icy applies a single confidence threshold, but one threshold cannot separate scores on reli- able tasks from those on unreliable ones, so it reduces coverage at no gain in quality. We demonstrate that in a fixed deployment scope, where the target tasks recur and validation data is available, a lightweight scope-aware router using only SLM-side features (token confi- dence plus task-scope identity) selects risky predictions far better. Our experiments show that at a fixed precision target it accepts about 11 points more values than a global confidence threshold (family-level calibration helps only marginally). Ablation experiments confirm the gain comes from task-scope reliability priors rather than a better confidence transformation. The router is an 8-feature gradient-boosted tree that adds negligible inference cost, making a strong fine-tuned SLM the low-cost tier of a cascade that optimizes the quality–cost tradeoff in real production settings.
Anthology ID:
2026.emnlp-industry.187
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pepa Atanasova, Gholamreza Haffari, Minghan Wang
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
3149–3160
Language:
URL:
https://aclanthology.org/2026.emnlp-industry.187/
DOI:
Bibkey:
Cite (ACL):
Fatemeh Mansoori, Andrea Scarinci, Aditya Aggarwal, Ashwin Chandramouli, and Suleiman A. Khan. 2026. When to Defer: Scope-Aware Cascades for Structured Attribute Generation in E-commerce Product Catalogs. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 3149–3160, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
When to Defer: Scope-Aware Cascades for Structured Attribute Generation in E-commerce Product Catalogs (Mansoori et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-industry.187.pdf