aiXplain SDK: A High-Level and Standardized Toolkit for AI Assets

Shreyas Sharma, Lucas Pavanelli, Thiago Castro Ferreira, Mohamed Al-Badrashiny, Hassan Sawaf


Abstract
The aiXplain SDK is an open-source Python toolkit which aims to simplify the wide and complex ecosystem of AI resources. The toolkit enables access to a wide selection of AI assets, including datasets, models, and metrics, from both academic and commercial sources, which can be selected, executed and evaluated in one place through different services in a standardized format with consistent documentation provided. The study showcases the potential of the proposed toolkit with different code examples and by using it on a user journey where state-of-the-art Large Language Models are fine-tuned on instruction prompt datasets, outperforming their base versions.
Anthology ID:
2024.inlg-main.37
Volume:
Proceedings of the 17th International Natural Language Generation Conference
Month:
September
Year:
2024
Address:
Tokyo, Japan
Editors:
Saad Mahamood, Nguyen Le Minh, Daphne Ippolito
Venue:
INLG
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
446–452
Language:
URL:
https://aclanthology.org/2024.inlg-main.37
DOI:
Bibkey:
Cite (ACL):
Shreyas Sharma, Lucas Pavanelli, Thiago Castro Ferreira, Mohamed Al-Badrashiny, and Hassan Sawaf. 2024. aiXplain SDK: A High-Level and Standardized Toolkit for AI Assets. In Proceedings of the 17th International Natural Language Generation Conference, pages 446–452, Tokyo, Japan. Association for Computational Linguistics.
Cite (Informal):
aiXplain SDK: A High-Level and Standardized Toolkit for AI Assets (Sharma et al., INLG 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.inlg-main.37.pdf