Explicit State Gating and Implicit Refusal for Unreadable Scene Text

Dayeon Jang, Yuseok Bae, Kimin Yun


Abstract
Scene text recognition systems must decide what to do when an image contains no reliably readable text. We compare two abstention contracts for a vision-language scene-text recognizer. Under implicit refusal, the model signals unreadability inside its own transcription output. Under explicit state gating, a separate five-way state classifier decides whether a transcription is emitted at all. Across four training variants sharing the same backbone, direct OCR yields similar accuracy on readable text; the two contracts differ mainly in how they handle inputs with no readable text. Gating reduces false transcription (emitting text where none is readable) from 45.9% to 1.7%, at the cost of falsely abstaining on 3.8% of readable inputs. Which contract is preferable, however, cannot be determined without first specifying how much a correct abstention is worth. When rejected inputs are excluded from scoring, all gated configurations show similar risk; when a correct abstention is credited as a useful outcome, gating lowers risk on the diagnostic set. We present this preliminary analysis not as a context-free model ranking, but as a framework for choosing an abstention contract at deployment time. These results motivate future systems that use the predicted state to select a recovery action before abstaining.
Anthology ID:
2026.uncertainlp-main.16
Volume:
The Proceedings of the Third Workshop on Uncertainty-Aware NLP
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Wilker Aziz, Jonathan Berant, Bryan Eikema, Evgenia Ilia, Marie-Catherine de Marneffe, Barbara Plank, Artem Shelmanov, Swabha Swayamdipta, Jörg Tiedemann, Artem Vazhentsev, Raúl Vázquez, Chrysoula Zerva
Venues:
UncertaiNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
275–279
Language:
URL:
https://aclanthology.org/2026.uncertainlp-main.16/
DOI:
Bibkey:
Cite (ACL):
Dayeon Jang, Yuseok Bae, and Kimin Yun. 2026. Explicit State Gating and Implicit Refusal for Unreadable Scene Text. In The Proceedings of the Third Workshop on Uncertainty-Aware NLP, pages 275–279, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Explicit State Gating and Implicit Refusal for Unreadable Scene Text (Jang et al., UncertaiNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.uncertainlp-main.16.pdf