Typed Relation Path Geometry in Sentence Embedding Spaces

Mingyue Liu, Ziyang Xing


Abstract
Lexical relations are not only labels on pairs of concepts: they are directed typed movements that can form paths. We study whether sentence embedding spaces preserve this structure at the level of individual relation instances. By representing two-hop lexical chains as composed movements on the normalised embedding sphere, we test whether true chains form more coherent routes than matched false-middle alternatives. Across controlled lexical path experiments, real chains exhibit a robust path signal, including for mixed relation compositions, and the composed movements retain information about ordered relation type. Beyond diagnosis, the same path geometry aligns with independent distributional context shifts and improves graded lexical-entailment transfer, indicating that it captures reusable lexical structure rather than a task-specific artefact.
Anthology ID:
2026.emnlp-main.2530
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
57548–57564
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2530/
DOI:
Bibkey:
Cite (ACL):
Mingyue Liu and Ziyang Xing. 2026. Typed Relation Path Geometry in Sentence Embedding Spaces. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 57548–57564, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Typed Relation Path Geometry in Sentence Embedding Spaces (Liu & Xing, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2530.pdf