SATS : Scenario-Anchored Topology-Inspired Structural Scoring

Dohyeon Kim, Jihoon Yang


Abstract
Sentence-level structural reasoning, reflected in relational connectivity patterns induced by attention distributions, plays an important role in grammatical acceptability judgment and figurative expression understanding. However, most existing scoring approaches rely primarily on token-level probability signals or sentence-level similarity, which do not explicitly capture structural relationships between tokens. We propose Scenario-Anchored Topology-Inspired Structural Scoring (SATS), a structure-aware comparison method that evaluates coherence between a scenario and multiple candidate interpretations using connectivity patterns derived from attention matrices. Unlike prior topology-inspired approaches that focus on pairwise comparisons, SATS directly supports multi-option reasoning while maintaining low computational cost. Experiments on BLiMP, FLUTE, and Pragmatics show that SATS improves encoder-based model performance in many settings and can approach the accuracy of much larger language models. These results suggest that explicit structural comparison can provide a useful complementary signal for the evaluated language understanding tasks.
Anthology ID:
2026.findings-emnlp.492
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
10313–10332
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.492/
DOI:
Bibkey:
Cite (ACL):
Dohyeon Kim and Jihoon Yang. 2026. SATS : Scenario-Anchored Topology-Inspired Structural Scoring. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 10313–10332, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SATS : Scenario-Anchored Topology-Inspired Structural Scoring (Kim & Yang, Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.492.pdf