Sensitivity of Syllable-Based ASR Predictions to Token Frequency and Lexical Stress

Alessandro Vietti, Domenico De Cristofaro, Picciau Sara


Abstract
Automatic Speech Recognition systems (ASR) based on neural networks achieve great results, but it remains unclear which are the linguistic features and representations that the models leverage to perform the recognition. In our study, we used phonological syllables as tokens to fine-tune an end-to-end ASR model due to their relevance as linguistic units. Furthermore, this strategy allowed us to keep track of different types of linguistic features characterizing the tokens. The analysis of the transcriptions generated by the model reveals that factors such as token frequency and lexical stress have a variable impact on the prediction strategies adopted by the ASR system.
Anthology ID:
2024.clicit-1.106
Volume:
Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)
Month:
December
Year:
2024
Address:
Pisa, Italy
Editors:
Felice Dell'Orletta, Alessandro Lenci, Simonetta Montemagni, Rachele Sprugnoli
Venue:
CLiC-it
SIG:
Publisher:
CEUR Workshop Proceedings
Note:
Pages:
983–989
Language:
URL:
https://aclanthology.org/2024.clicit-1.106/
DOI:
Bibkey:
Cite (ACL):
Alessandro Vietti, Domenico De Cristofaro, and Picciau Sara. 2024. Sensitivity of Syllable-Based ASR Predictions to Token Frequency and Lexical Stress. In Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024), pages 983–989, Pisa, Italy. CEUR Workshop Proceedings.
Cite (Informal):
Sensitivity of Syllable-Based ASR Predictions to Token Frequency and Lexical Stress (Vietti et al., CLiC-it 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.clicit-1.106.pdf