Manifold Embedding: A Point-to-Hyperplane Approach

Xianglong Shi, Yunhan Jiang, Nicu Sebe, Ziheng Chen


Abstract
Neural networks over non-Euclidean manifolds have attracted increasing attention across various applications. A fundamental step in these networks is to map Euclidean features onto a target manifold. Existing methods mainly use exponential maps and projections, operate through tangent or ambient Euclidean spaces, and may therefore distort intrinsic manifold geometry. On the other hand, point-to-hyperplane distances have recently shown great success in building manifold-valued networks. Based on this, we propose the Point-to-Hyperplane Distance Map (PHDM), a parameter-free mapping that extends Euclidean fully connected layers to Euclidean-to-manifold transformations. Specially, the exponential map is recovered as a pseudo-distance-based special case. We manifest PHDM on the Lorentz, Poincaré, spherical, and projected-spherical models, covering both negative and positive curvature. Experiments on arithmetic reasoning across four LLMs, image classification, graph node classification, and link prediction demonstrate consistent improvements over the corresponding baselines. The code is available at https://github.com/Longchentong/PHDM.
Anthology ID:
2026.emnlp-main.1532
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
34982–35001
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1532/
DOI:
Bibkey:
Cite (ACL):
Xianglong Shi, Yunhan Jiang, Nicu Sebe, and Ziheng Chen. 2026. Manifold Embedding: A Point-to-Hyperplane Approach. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 34982–35001, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Manifold Embedding: A Point-to-Hyperplane Approach (Shi et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1532.pdf