Unified Work Embeddings: Contrastive Learning of a Bidirectional Multi-task Ranker

Matthias De Lange, Warre Veys, Jens-Joris Decorte, Jeroen Van Hautte


Abstract
Applications in labor market intelligence demand specialized NLP systems for a wide range of tasks, characterized by extreme multi-label target spaces, strict latency constraints, and multiple text modalities such as skills and job titles. These constraints have led to isolated, task-specific developments in the field, with models and benchmarks focused on single prediction tasks. Exploiting the shared structure of work-related data, we propose a unifying framework, combining a wide range of tasks in a multi-task ranking benchmark, and a flexible architecture tackling text-driven work tasks with a single model. The benchmark, WorkBench, is the first unified evaluation suite spanning six work-related tasks formulated explicitly as ranking problems, curated from real-world ontologies and human-annotated resources. WorkBench enables cross-task analysis, where we find significant positive cross-task transfer. This insight leads to Unified Work Embeddings (UWE), a task-agnostic bi-encoder that exploits our training-data structure with a many-to-many InfoNCE objective, and leverages token-level embeddings with task-agnostic soft late interaction. UWE demonstrates zero-shot ranking performance on unseen target spaces in the work domain, and enables low-latency inference with two orders of magnitude fewer parameters than best-performing generalist models that are not tailored to the work domain (Qwen3-8B), with +4.4 MAP improvement.
Anthology ID:
2026.emnlp-main.442
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
10196–10213
Language:
URL:
https://aclanthology.org/2026.emnlp-main.442/
DOI:
Bibkey:
Cite (ACL):
Matthias De Lange, Warre Veys, Jens-Joris Decorte, and Jeroen Van Hautte. 2026. Unified Work Embeddings: Contrastive Learning of a Bidirectional Multi-task Ranker. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 10196–10213, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Unified Work Embeddings: Contrastive Learning of a Bidirectional Multi-task Ranker (De Lange et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.442.pdf