Varying Sentence Representations via Condition-Specified Routers

Ziyong Lin, Quansen Wang, Zixia Jia, Zilong Zheng


Abstract
Semantic similarity between two sentences is inherently subjective and can vary significantly based on the specific aspects emphasized. Consequently, traditional sentence encoders must be capable of generating conditioned sentence representations that account for diverse conditions or aspects. In this paper, we propose a novel yet efficient framework based on transformer-style language models that facilitates advanced conditioned sentence representation while maintaining model parameters and computational efficiency. Empirical evaluations on the Conditional Semantic Textual Similarity and Knowledge Graph Completion tasks demonstrate the superiority of our proposed framework.
Anthology ID:
2024.emnlp-main.963
Volume:
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
17390–17401
Language:
URL:
https://aclanthology.org/2024.emnlp-main.963
DOI:
Bibkey:
Cite (ACL):
Ziyong Lin, Quansen Wang, Zixia Jia, and Zilong Zheng. 2024. Varying Sentence Representations via Condition-Specified Routers. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 17390–17401, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
Varying Sentence Representations via Condition-Specified Routers (Lin et al., EMNLP 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.emnlp-main.963.pdf