FoQA: A Faroese Question-Answering Dataset

Annika Simonsen, Dan Saattrup Nielsen, Hafsteinn Einarsson


Abstract
We present FoQA, a Faroese extractive question-answering (QA) dataset with 2,000 samples, created using a semi-automated approach combining Large Language Models (LLMs) and human validation. The dataset was generated from Faroese Wikipedia articles using GPT-4-turbo for initial QA generation, followed by question rephrasing to increase complexity and native speaker validation to ensure quality. We provide baseline performance metrics for FoQA across multiple models, including LLMs and BERT, demonstrating its effectiveness in evaluating Faroese QA performance. The dataset is released in three versions: a validated set of 2,000 samples, a complete set of all 10,001 generated samples, and a set of 2,395 rejected samples for error analysis.
Anthology ID:
2025.resourceful-1.11
Volume:
Proceedings of the Third Workshop on Resources and Representations for Under-Resourced Languages and Domains (RESOURCEFUL-2025)
Month:
March
Year:
2025
Address:
Tallinn, Estonia
Editors:
Špela Arhar Holdt, Nikolai Ilinykh, Barbara Scalvini, Micaella Bruton, Iben Nyholm Debess, Crina Madalina Tudor
Venues:
RESOURCEFUL | WS
SIG:
Publisher:
University of Tartu Library, Estonia
Note:
Pages:
48–57
Language:
URL:
https://aclanthology.org/2025.resourceful-1.11/
DOI:
Bibkey:
Cite (ACL):
Annika Simonsen, Dan Saattrup Nielsen, and Hafsteinn Einarsson. 2025. FoQA: A Faroese Question-Answering Dataset. In Proceedings of the Third Workshop on Resources and Representations for Under-Resourced Languages and Domains (RESOURCEFUL-2025), pages 48–57, Tallinn, Estonia. University of Tartu Library, Estonia.
Cite (Informal):
FoQA: A Faroese Question-Answering Dataset (Simonsen et al., RESOURCEFUL 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.resourceful-1.11.pdf