PrimeQA: The Prime Repository for State-of-the-Art Multilingual Question Answering Research and Development

Avi Sil, Jaydeep Sen, Bhavani Iyer, Martin Franz, Kshitij Fadnis, Mihaela Bornea, Sara Rosenthal, Scott McCarley, Rong Zhang, Vishwajeet Kumar, Yulong Li, Md Arafat Sultan, Riyaz Bhat, Juergen Bross, Radu Florian, Salim Roukos


Abstract
The field of Question Answering (QA) has made remarkable progress in recent years, thanks to the advent of large pre-trained language models, newer realistic benchmark datasets with leaderboards, and novel algorithms for key components such as retrievers and readers. In this paper, we introduce PrimeQA: a one-stop and open-source QA repository with an aim to democratize QA research and facilitate easy replication of state-of-the-art (SOTA) QA methods. PrimeQA supports core QA functionalities like retrieval and reading comprehension as well as auxiliary capabilities such as question generation. It has been designed as an end-to-end toolkit for various use cases: building front-end applications, replicating SOTA methods on public benchmarks, and expanding pre-existing methods. PrimeQA is available at: https://github.com/primeqa.
Anthology ID:
2023.acl-demo.5
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Danushka Bollegala, Ruihong Huang, Alan Ritter
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
51–62
Language:
URL:
https://aclanthology.org/2023.acl-demo.5
DOI:
10.18653/v1/2023.acl-demo.5
Bibkey:
Cite (ACL):
Avi Sil, Jaydeep Sen, Bhavani Iyer, Martin Franz, Kshitij Fadnis, Mihaela Bornea, Sara Rosenthal, Scott McCarley, Rong Zhang, Vishwajeet Kumar, Yulong Li, Md Arafat Sultan, Riyaz Bhat, Juergen Bross, Radu Florian, and Salim Roukos. 2023. PrimeQA: The Prime Repository for State-of-the-Art Multilingual Question Answering Research and Development. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations), pages 51–62, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
PrimeQA: The Prime Repository for State-of-the-Art Multilingual Question Answering Research and Development (Sil et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-demo.5.pdf
Video:
 https://aclanthology.org/2023.acl-demo.5.mp4