Applying the transformer architecture on the task of headline selection for Finnish news texts

Maria Adamova, Maria Khokhlova


Abstract
The paper evaluates the possibilities of using transformer architecture in creating headlines for news texts in Finnish. The authors statistically analyse the original and generated headlines according to three criteria: informativeness, relevance and impact. The study also substantiates for the first time the effectiveness of a fine-tuned text-to-text transfer transformer model within the task of generating headlines for news articles in Finnish. The results show that there is no statistically significant difference between the scores obtained by the original and generated headlines on the mentioned criteria of informativeness, relevance and impact.
Anthology ID:
2024.iwclul-1.15
Volume:
Proceedings of the 9th International Workshop on Computational Linguistics for Uralic Languages
Month:
November
Year:
2024
Address:
Helsinki, Finland
Editors:
Mika Hämäläinen, Flammie Pirinen, Melany Macias, Mario Crespo Avila
Venue:
IWCLUL
SIG:
SIGUR
Publisher:
Association for Computational Linguistics
Note:
Pages:
115–122
Language:
URL:
https://aclanthology.org/2024.iwclul-1.15
DOI:
Bibkey:
Cite (ACL):
Maria Adamova and Maria Khokhlova. 2024. Applying the transformer architecture on the task of headline selection for Finnish news texts. In Proceedings of the 9th International Workshop on Computational Linguistics for Uralic Languages, pages 115–122, Helsinki, Finland. Association for Computational Linguistics.
Cite (Informal):
Applying the transformer architecture on the task of headline selection for Finnish news texts (Adamova & Khokhlova, IWCLUL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.iwclul-1.15.pdf