MQDD: Pre-training of Multimodal Question Duplicity Detection for Software Engineering Domain

Jan Pasek, Jakub Sido, Miloslav Konopik, Ondrej Prazak


Abstract
This work proposes a new pipeline for leveraging data collected on the Stack Overflow website for pre-training a multimodal model for searching duplicates on question answering websites. Our multimodal model is trained on question descriptions and source codes in multiple programming languages. We design two new learning objectives to improve duplicate detection capabilities. The result of this work is a mature, fine-tuned Multimodal Question Duplicity Detection (MQDD) model, ready to be integrated into a Stack Overflow search system, where it can help users find answers for already answered questions. Alongside the MQDD model, we release two datasets related to the software engineering domain. The first Stack Overflow Dataset (SOD) represents a massive corpus of paired questions and answers. The second Stack Overflow Duplicity Dataset (SODD) contains data for training duplicate detection models.
Anthology ID:
2023.ranlp-1.89
Volume:
Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing
Month:
September
Year:
2023
Address:
Varna, Bulgaria
Editors:
Ruslan Mitkov, Galia Angelova
Venue:
RANLP
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
824–835
Language:
URL:
https://aclanthology.org/2023.ranlp-1.89
DOI:
Bibkey:
Cite (ACL):
Jan Pasek, Jakub Sido, Miloslav Konopik, and Ondrej Prazak. 2023. MQDD: Pre-training of Multimodal Question Duplicity Detection for Software Engineering Domain. In Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing, pages 824–835, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
MQDD: Pre-training of Multimodal Question Duplicity Detection for Software Engineering Domain (Pasek et al., RANLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.ranlp-1.89.pdf