PsychoLex: Unveiling the Psychological Mind of Large Language Models

Mohammad Amin Abbasi, Farnaz Sadat Mirnezami, Hassan Naderi


Abstract
This paper explores the intersection of psychology and artificial intelligence through the development and evaluation of specialized Large Language Models (LLMs). We introduce PsychoLex , a suite of resources designed to enhance LLMs’ proficiency in psychological tasks in both Persian and English. Key contributions include the PsychoLexQA dataset for instructional content and the PsychoLexEval dataset for rigorous evaluation of LLMs in complex psychological scenarios. Additionally, we present the PsychoLexLLaMA model, optimized specifically for psychological applications, demonstrating superior performance compared to general-purpose models. The findings underscore the potential of tailored LLMs for advancing psychological research and applications, while also highlighting areas for further refinement. This research offers a foundational step towards integrating LLMs into specialized psychological domains, with implications for future advancements in AI-driven psychological practice.
Anthology ID:
2024.nlp4science-1.4
Volume:
Proceedings of the 1st Workshop on NLP for Science (NLP4Science)
Month:
November
Year:
2024
Address:
Miami, FL, USA
Editors:
Lotem Peled-Cohen, Nitay Calderon, Shir Lissak, Roi Reichart
Venue:
NLP4Science
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
24–35
Language:
URL:
https://aclanthology.org/2024.nlp4science-1.4
DOI:
Bibkey:
Cite (ACL):
Mohammad Amin Abbasi, Farnaz Sadat Mirnezami, and Hassan Naderi. 2024. PsychoLex: Unveiling the Psychological Mind of Large Language Models. In Proceedings of the 1st Workshop on NLP for Science (NLP4Science), pages 24–35, Miami, FL, USA. Association for Computational Linguistics.
Cite (Informal):
PsychoLex: Unveiling the Psychological Mind of Large Language Models (Abbasi et al., NLP4Science 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.nlp4science-1.4.pdf