KD-Boost: Boosting Real-Time Semantic Matching in E-commerce with Knowledge Distillation

Sanjay Agrawal, Vivek Sembium, Ankith M S


Abstract
Real-time semantic matching is vital to web and product search. Transformer-based models have shown to be highly effective at encoding queries into an embedding space where semantically similar entities (queries or results) are in close proximity. However, the computational complexity of large transformer models limits their utilization for real-time matching. In this paper, we propose KD-Boost, a novel knowledge distillation algorithm designed for real-time semantic matching. KD-Boost trains low latency accurate student models by leveraging soft labels from a teacher model as well as ground truth via pairwise query-product and query-query signal derived from direct audits, user behavior, and taxonomy-based data using custom loss functions. Experiments on internal and external e-commerce datasets demonstrate an improvement of 2-3% ROC-AUC compared to training student models directly, outperforming teacher and SOTA knowledge distillation benchmarks. Simulated online A/B tests using KD-Boost for automated Query Reformulation (QR) indicate a 6.31% increase in query-to-query matching, 2.76% increase in product coverage, and a 2.19% improvement in relevance.
Anthology ID:
2023.emnlp-industry.14
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
December
Year:
2023
Address:
Singapore
Editors:
Mingxuan Wang, Imed Zitouni
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
131–141
Language:
URL:
https://aclanthology.org/2023.emnlp-industry.14
DOI:
10.18653/v1/2023.emnlp-industry.14
Bibkey:
Cite (ACL):
Sanjay Agrawal, Vivek Sembium, and Ankith M S. 2023. KD-Boost: Boosting Real-Time Semantic Matching in E-commerce with Knowledge Distillation. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 131–141, Singapore. Association for Computational Linguistics.
Cite (Informal):
KD-Boost: Boosting Real-Time Semantic Matching in E-commerce with Knowledge Distillation (Agrawal et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-industry.14.pdf
Video:
 https://aclanthology.org/2023.emnlp-industry.14.mp4