Gradient-Boosted Decision Tree for Listwise Context Model in Multimodal Review Helpfulness Prediction

Thong Nguyen, Xiaobao Wu, Xinshuai Dong, Cong-Duy Nguyen, Zhen Hai, Lidong Bing, Anh Tuan Luu


Abstract
Multimodal Review Helpfulness Prediction (MRHP) aims to rank product reviews based on predicted helpfulness scores and has been widely applied in e-commerce via presenting customers with useful reviews. Previous studies commonly employ fully-connected neural networks (FCNNs) as the final score predictor and pairwise loss as the training objective. However, FCNNs have been shown to perform inefficient splitting for review features, making the model difficult to clearly differentiate helpful from unhelpful reviews. Furthermore, pairwise objective, which works on review pairs, may not completely capture the MRHP goal to produce the ranking for the entire review list, and possibly induces low generalization during testing. To address these issues, we propose a listwise attention network that clearly captures the MRHP ranking context and a listwise optimization objective that enhances model generalization. We further propose gradient-boosted decision tree as the score predictor to efficaciously partition product reviews’ representations. Extensive experiments demonstrate that our method achieves state-of-the-art results and polished generalization performance on two large-scale MRHP benchmark datasets.
Anthology ID:
2023.findings-acl.106
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1670–1696
Language:
URL:
https://aclanthology.org/2023.findings-acl.106
DOI:
10.18653/v1/2023.findings-acl.106
Bibkey:
Cite (ACL):
Thong Nguyen, Xiaobao Wu, Xinshuai Dong, Cong-Duy Nguyen, Zhen Hai, Lidong Bing, and Anh Tuan Luu. 2023. Gradient-Boosted Decision Tree for Listwise Context Model in Multimodal Review Helpfulness Prediction. In Findings of the Association for Computational Linguistics: ACL 2023, pages 1670–1696, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Gradient-Boosted Decision Tree for Listwise Context Model in Multimodal Review Helpfulness Prediction (Nguyen et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.106.pdf
Video:
 https://aclanthology.org/2023.findings-acl.106.mp4