NLP_STR_teamS at SemEval-2024 Task1: Semantic Textual Relatedness based on MASK Prediction and BERT Model

Lianshuang Su, Xiaobing Zhou


Abstract
This paper describes our participation in the SemEval-2024 Task 1, “Semantic Textual Relatedness for African and Asian Languages.” This task detects the degree of semantic relatedness between pairs of sentences. Our approach is to take out the sentence pairs of each instance to construct a new sentence as the prompt template, use MASK to predict the correlation between the two sentences, use the BERT pre-training model to process and calculate the text sequence, and use the synonym replacement method in text data augmentation to expand the size of the data set. We participate in English in track A, which uses a supervised approach, and the Spearman Correlation on the test set is 0.809.
Anthology ID:
2024.semeval-1.51
Volume:
Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024)
Month:
June
Year:
2024
Address:
Mexico City, Mexico
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Harish Tayyar Madabushi, Giovanni Da San Martino, Sara Rosenthal, Aiala Rosá
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
337–341
Language:
URL:
https://aclanthology.org/2024.semeval-1.51
DOI:
Bibkey:
Cite (ACL):
Lianshuang Su and Xiaobing Zhou. 2024. NLP_STR_teamS at SemEval-2024 Task1: Semantic Textual Relatedness based on MASK Prediction and BERT Model. In Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024), pages 337–341, Mexico City, Mexico. Association for Computational Linguistics.
Cite (Informal):
NLP_STR_teamS at SemEval-2024 Task1: Semantic Textual Relatedness based on MASK Prediction and BERT Model (Su & Zhou, SemEval 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.semeval-1.51.pdf
Supplementary material:
 2024.semeval-1.51.SupplementaryMaterial.txt
Supplementary material:
 2024.semeval-1.51.SupplementaryMaterial.zip