Variable-size Discovery and Representation of Atomic Propositions

Francesco Ortame, Roberto Navigli


Abstract
Sentence embeddings represent meaning as a single fixed-size vector, regardless of the complexity of the input sentence. This design compresses all propositional structure into a single point, losing part of the internal structure of the sentence in the process. To address this, we introduce Atomic Proposition Embeddings (APE) to dynamically discover and encode atomic propositions in sentences as variable-size bags of vectors. We use a slot mechanism, inspired by object detection in computer vision, over an encoder backbone. APE is trained on a proposition-decomposed version of WikiSplit, and matches or outperforms sentence encoders up to 15x its size on PAWS-Wiki and SNLI with no task-specific fine-tuning, using proposition-level scoring rules at inference time. We further introduce PropSearch, a retrieval benchmark for proposition-level embeddings in which models must retrieve source sentences given atomic propositions. APE leads on PropSearch over proposition-level alternatives, with its advantage growing with sentence complexity. Ablations confirm the gains are architectural rather than data-driven and that APE can generalize over its training signal. We release our code, data and models for research purposes at https://github.com/SapienzaNLP/APE.
Anthology ID:
2026.emnlp-main.2302
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
52330–52348
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2302/
DOI:
Bibkey:
Cite (ACL):
Francesco Ortame and Roberto Navigli. 2026. Variable-size Discovery and Representation of Atomic Propositions. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 52330–52348, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Variable-size Discovery and Representation of Atomic Propositions (Ortame & Navigli, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2302.pdf