Identifying High Consideration E-Commerce Search Queries

Zhiyu Chen, Jason Ingyu Choi, Besnik Fetahu, Shervin Malmasi


Abstract
In e-commerce, high consideration search missions typically require careful and elaborate decision making, and involve a substantial research investment from customers. We consider the task of identifying High Consideration (HC) queries. Identifying such queries enables e-commerce sites to better serve user needs using targeted experiences such as curated QA widgets that help users reach purchase decisions. We explore the task by proposing an Engagement-based Query Ranking (EQR) approach, focusing on query ranking to indicate potential engagement levels with query-related shopping knowledge content during product search. Unlike previous studies on predicting trends, EQR prioritizes query-level features related to customer behavior, finance, and catalog information rather than popularity signals. We introduce an accurate and scalable method for EQR and present experimental results demonstrating its effectiveness. Offline experiments show strong ranking performance. Human evaluation shows a precision of 96% for HC queries identified by our model. The model was commercially deployed, and shown to outperform human-selected queries in terms of downstream customer impact, as measured through engagement.
Anthology ID:
2024.emnlp-industry.42
Volume:
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
November
Year:
2024
Address:
Miami, Florida, US
Editors:
Franck Dernoncourt, Daniel Preoţiuc-Pietro, Anastasia Shimorina
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
563–572
Language:
URL:
https://aclanthology.org/2024.emnlp-industry.42
DOI:
Bibkey:
Cite (ACL):
Zhiyu Chen, Jason Ingyu Choi, Besnik Fetahu, and Shervin Malmasi. 2024. Identifying High Consideration E-Commerce Search Queries. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 563–572, Miami, Florida, US. Association for Computational Linguistics.
Cite (Informal):
Identifying High Consideration E-Commerce Search Queries (Chen et al., EMNLP 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.emnlp-industry.42.pdf
Poster:
 2024.emnlp-industry.42.poster.pdf