Can LLM Agents Identify Spoken Dialects like a Linguist?

Tobias Bystrich, Lukas Hamm, Maria Hassan Akhter, Lea Fischbach, Lucie Flek, Akbar Karimi


Abstract
Due to the scarcity of labeled dialectal speech, audio dialect classification is a challenging task for most languages, including Swiss German. In this work, we explore the ability of large language models (LLMs) as agents in understanding the dialects and whether they can show comparable performance to models such as HuBERT in dialect classification. In addition, we provide an LLM baseline and a human linguist one. Our approach uses phonetic transcriptions produced by ASR systems and combines them with linguistic resources such as dialect feature maps, vowel history, and rules. Our findings indicate that, when linguistic information is provided, the LLM predictions improve. The human baseline shows that automatically generated transcriptions can be beneficial for such classifications, but also present opportunities for improvement.
Anthology ID:
2026.dialres-1.8
Volume:
Proceedings of the First Workshop on Dialects in NLP — A Resource Perspective
Month:
May
Year:
2026
Address:
Palma de Mallorca
Editors:
Antonis Anastasopoulos, Stella Markantonatou, Angela Ralli, Marcos Zampieri, Stavros Bompolas, Vivian Stamou
Venues:
DialRes | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
83–92
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-dialres-08
DOI:
10.63317/27m2tbgjcat8
Bibkey:
Cite (ACL):
Tobias Bystrich, Lukas Hamm, Maria Hassan Akhter, Lea Fischbach, Lucie Flek, and Akbar Karimi. 2026. Can LLM Agents Identify Spoken Dialects like a Linguist?. In Proceedings of the First Workshop on Dialects in NLP — A Resource Perspective, pages 83–92, Palma de Mallorca. Association for Computational Linguistics.
Cite (Informal):
Can LLM Agents Identify Spoken Dialects like a Linguist? (Bystrich et al., DialRes 2026)
Copy Citation: